🚀[FEA]: Add better IO support
dallasfoster opened this issue · comments
Is this a new feature, an improvement, or a change to existing functionality?
New Feature
How would you describe the priority of this feature request
Critical (currently preventing usage)
Please provide a clear description of problem you would like to solve.
We should update IO support to be easier to use, not just in pipelines.
- We should support a variety of backends, mainly through xarray.
- We should use the notion that data carries around with it metadata (and the metadata should be sufficient to instantiate an xarray dataset/dataArray.
- We should limit how many variables can be added to a dataset.
- Users should be able to add their own backends without adding PR's to the repo.
Describe any alternatives you have considered
No response
Closing based on internal discussions