kerchunk 0.2.9-1
Package Information
| Description | Cloud-friendly access to archival data Kerchunk is a library that provides a unified way to represent a variety of chunked, compressed data formats (e.g. NetCDF, HDF5, GRIB), allowing efficient access to the data from traditional file systems or cloud object storage. It also provides a flexible way to create virtual datasets from multiple files. It does this by extracting the byte ranges, compression information and other information about the data and storing this metadata in a new, separate object. This means that you can create a virtual aggregate dataset over potentially many source files, for efficient, parallel and cloud-friendly *in-situ* access without having to copy or translate the originals. It is a gateway to in-the-cloud massive data processing while the data providers still insist on using legacy formats for archival storage. Features: * completely serverless architecture * metadata consolidation, so you can understand a many-file dataset (metadata plus physical storage) in a single read * read from all of the storage backends supported by fsspec, including object storage (s3, gcs, abfs, alibaba), http, cloud user storage (dropbox, gdrive) and network protocols (ftp, ssh, hdfs, smb...) * loading of various file types (currently netcdf4/HDF, grib2, tiff, fits, zarr), potentially heterogeneous within a single dataset, without a need to go via the specific driver (e.g., no need for h5py) * asynchronous concurrent fetch of many data chunks in one go, amortizing the cost of latency * parallel access with a library like zarr without any locks * logical datasets viewing many (>~millions) data files, and direct access/subselection to them via coordinate indexing across an arbitrary number of dimensions |
|---|---|
| Maintainer | Debian GIS Project <pkg-grass-devel@lists.alioth.debian.org> |
| Changed By | Antonio Valentino <antonio.valentino@tiscali.it> |
| Sponsor | sebastic@xs4all.nl |
| Distribution | unstable |
| Architecture | all |
| VCS | git: https://salsa.debian.org/debian-gis-team/kerchunk.git (browse) |
| Closes | #1124102 |
| Tracker | https://tracker.debian.org/pkg/kerchunk |
| Uploaded | 1 month, 16 days ago |
New Package Report
.changes
| Changed-By | Antonio Valentino |
|---|---|
| Architecture | source all |
| Distribution | unstable |
| Date | Sun, 28 Dec 2025 08:17:47 +0000 |
| Source | kerchunk |
| Version | 0.2.9-1 |
.dsc
| Priority | optional |
|---|---|
| Component | main |
| Package-List | python-kerchunk-doc deb doc optional arch=all python3-kerchunk deb python optional arch=all |
| Section | doc |
debian/copyright
Format: https://www.debian.org/doc/packaging-manuals/copyright-format/1.0/ Upstream-Name: kerchunk Upstream-Contact: Martin Durant <martin.durant@alumni.utoronto.ca> Source: https://github.com/fsspec/kerchunk Files: * Copyright: 2020, Intake License: Expat Files: debian/* Copyright: 2025, Antonio Valentino <antonio.valentino@tiscali.it> License: Expat License: Expat Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: . The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. . THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.