Giters

observingClouds / slkspec

fsspec filesystem for stronglink tape archive

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Combination of retrievals

observingClouds opened this issue · comments

commented

There are a couple of examples where the combination of retrievals is not working efficiently yet or has some issues:

  • retrieval of resources opened with pure fsspec without url-chaining
  • #9
  • #10
  • #11
  • #19
commented

There are a couple of examples where the combination of retrievals is not working efficiently yet or has some issues:

* [x]  retrieval of resources opened with pure fsspec without url-chaining

* [ ]  [Combining retrievals from different subdirectories #9](https://github.com/observingClouds/slkspec/issues/9)

* [ ]  [Retrieval starts before queue is filled with all requests #10](https://github.com/observingClouds/slkspec/issues/10)

* [ ]  [Combination of retrievals is not working when using url chaining #11](https://github.com/observingClouds/slkspec/issues/11)

* [ ]  [Retrievals in combination with xarray depend on the used cluster #19](https://github.com/observingClouds/slkspec/issues/19)

So if I see this correctly, then most of the problems arise from zarr. I believe that there is very little we can do at the moment. Because in order to make this work we would have to change the zarr library.