ratt-ru / dask-ms

Implementation of a dask/xarray dataset backed by a CASA MS

https://dask-ms.readthedocs.io

ratt-ru/dask-ms Issues

Silently fails when providing incorrect schema for WEIGHT column
Closed 2 months ago1
Capitalised ROWID breaks xarray lowercase coordinate naming convention
Updated 4 months ago
Dask-ms deadlocks on fork() in non-synchronous dask scheduling mode
Closed 5 months ago4
Python-casacore dependencies are too strict, add support back for python3.8
Closed 5 months ago1
Table::lock cannot sync table: another process changed the number of columns
Closed 7 months ago3
Test suite fails on pyarrow 13.0.0 due to new dependency on Pandas
Updated 9 months ago
Performance issue in bispectrum method and gradient
Updated 9 months ago10
Experimental clean-up release
Updated 9 months ago6
xds_from_zarr drops ROWID when requesting a subset of columns
Closed 10 months ago6
`daskms.experimental.xds_to_zarr` may fail due to large chunks
Updated a year ago
convert over NetFS
Closed a year ago2
Dask version semantics overly strict in pyproject.toml
Closed a year ago1
Parallelize or map chunks of an MS and an image to compute chi2 gradient
Updated a year ago4
Calculating Bispectrum with dask-ms and without loops
Closed a year ago8
Consolidate MS support into xds_{from,to}_ms
Updated 2 years ago1
read, join, and write MS
Updated 2 years ago6
MS descriptors don't support optional columns
Closed 2 years ago2
Non-standard MS columns have an auto-generated schema which is not chunked according to logic for standard dimensions
Updated 2 years ago17
BUG?: LocalFileSystem object error
Closed 2 years ago6
Dataset versioning
Updated 2 years ago20
Expose column keywords in Variable attrs
Closed 2 years ago5
Support taql query when converting from CASA format
Closed 2 years ago1
Mistakenly attempting to access a subtable as a main table causes weird behaviour
Closed 2 years ago
xds_from_zarr should fall over if argument doesn't point to anything
Closed 2 years ago
Chunking size mismatch introduced in dataset writing in version 0.2.12
Closed 2 years ago13
Pygments style is not respected in dask-ms documentation, leading to ugly lime green code block backgrounds
Closed 2 years ago1
Enhancements to dask-ms convert (verify chunk sizes and select which columns to convert)
Closed 2 years ago
ZARR metadata consolidation consolidates MAIN and subtable metadata into one file
Closed 2 years ago
Mismatched chunks between data_vars and ROWID gives weird results.
Closed 2 years ago
need flexible ways to specify dask-ms/storage_options.json
Closed 2 years ago
dask-ms does not scale with big datasets (spectral line datasets)
Closed 2 years ago21
How to map correlations to Stokes parameters without looping the correlations?
Updated 2 years ago4
Document experimental Zarr and Apache Arrow formats
Updated 2 years ago
Document dask-ms convert
Updated 2 years ago
Document performance tuning
Updated 2 years ago
Reintroduce warnings for non-contiguous data
Updated 2 years ago
Add quiet mode to `xds_from_storage*` functions
Updated 2 years ago
`xds_from_parquet` ignores requested chunks
Closed 2 years ago1
Support rechunking of non-row axes in `xds_from_parquet`.
Updated 2 years ago
Make xarray a default dependency
Updated 2 years ago2
xds_to_storage to complement xds_from_storage
Closed 2 years ago1
Expose on disk chunks
Closed 2 years ago2
Inappropriate channel tiling
Closed 2 years ago
`xds_to_zarr` behaviour when selecting columns
Closed 2 years ago
By default xds_to_table will create columns with standard (instead of tiled) storage managers
Closed 2 years ago8
dask-ms convert doesn't support index_cols
Closed 2 years ago1
How to deal with file locks properly in a distributed environment
Updated 2 years ago
xds_from_storage_* functions need documentation
Updated 2 years ago
`dask-ms convert` from MS to Parquet is very slow
Closed 2 years ago2
xds_from_zarr only respects requested chunk size on first Dataset
Closed 2 years ago3