fsspec / kerchunk

Cloud-friendly access to archival data

https://fsspec.github.io/kerchunk/

fsspec/kerchunk Issues

Control chunksize of the underlying zarrdata
Updated 5 months ago
Help with Parquet storage
Updated 5 months ago75
multiple reads of nasa-nex-gddp-cmip6 dataset from MultiZarrToZarr concatenated metadata returns all nans
Updated 5 months ago1
Parquet reference generation failing at translate step
Closed 6 months ago9
Grib2 Split File with read ahead?
Closed 6 months ago2
Unexpected behavior with MultiZarrToZarr with partial chunks.
Updated 6 months ago1
Data for variable is not inlined despite size below threshold
Closed 6 months ago8
Tests failing after upstream change to LazyReferenceMapper
Closed 7 months ago
Failure to combine multiple JSON reference files via MultiZarrToZarr()
Closed 7 months ago23
Best practice for using `rename_target_files`
Updated 7 months ago5
Refactor MultiZarrToZarr into multiple functions
Updated 7 months ago24
[BUG] MultiZarrToZarr fails to concatenate dimension coordinate variables
Updated 7 months ago10
_FillValue from a classic netCDF file does not end up in the kerchunk json
Closed 7 months ago4
SingleHdf5ToZarr error/warning with scalar utf-8/ascii dataset
Updated 7 months ago4
Add `xarray.open_dataset` backend
Updated 7 months ago8
Issue reading GZIP compressed GRIB2 remote file
Updated 7 months ago6
v0.2.1 broke existing workflows - 'SingleHdf5ToZarr' object has no attribute 'decoders'
Closed 7 months ago2
release?
Closed 7 months ago6
Status of JSON Schema for references spec
Updated 8 months ago1
Dataclass for "VirtualZarrStore"
Updated 8 months ago1
Refactor file format backend openers
Updated 8 months ago1
Memory leak in `scan_grib`?
Closed 8 months ago2
Kerchunk tutorial for July ESIP Meeting
Closed 8 months ago14
Coordinate Variables have incorrect shapes and chunks if name matches a dimension
Closed 8 months ago
NetCDF3ToZarr: `KeyError: '__padding_16' when translating
Closed 8 months ago1
Concatenating datasets with staggered grids
Updated 8 months ago6
Represent (coordinate) variables "symbolically"
Updated 8 months ago8
Variables missing from 'scan_grib', but findable with xarray and cfgrib
Updated 9 months ago11
Create coordinate from dimension?
Updated 9 months ago1
Support HDF5 compression filter plugins
Closed 9 months ago11
translate error "ValueError: Shuffle buffer is not an integer multiple of elementsize"
Closed 10 months ago34
building an index for *remote* zarr sources fails, due to `single_zarr` bug
Updated 10 months ago4
Creating index for single zarr-in-zip stores
Updated 10 months ago2
Despite more times available, dataset read from `MultiZarrToZarr` returns specific number time steps
Closed 10 months ago6
Issue using `tiff_to_zarr`
Updated 10 months ago10
`tiff_to_zarr` ValueError: incomplete chunks are not supported by the fsspec ReferenceFileSystem
Updated 10 months ago4
UserWarning / NotImplementedError
Closed a year ago4
Allow file scanners to write straight to parquet
Updated a year ago
MultiZarrToZarr for non-spatial HDF5 files
Closed a year ago7
Regression in 0.0.8-0.0.9 release causes race condition & segfault in eccodes grib_string_length
Closed a year ago10
Is it possible to create a kerchunk mapping that has different chunk sizes than the underlying file.
Closed a year ago4
TIFF: internal codec (small chunks) vs. entire file as single chunk (`imagecodecs_tiff` codec)
Updated a year ago10
Should there be a `kerchunk[parquet]` optional install for `fastparquet`?
Updated a year ago3
Link SECM MOM6 workflow as a case study?
Updated a year ago5
write parquet in MultiZarrToZarr
Updated a year ago2
tiff_to_zarr for geotiff with compression: zarr reads strange values
Closed a year ago14
Error when trying to open dataset with xarray
Closed a year ago9
Read json dictionary of references instead of list of json references
Updated a year ago3
`combine.MultiZarrToZarr` producing broken reference file
Closed a year ago3
Is it possible to open remote ensemble datasets?
Closed a year ago2