LSSTDESC / tables_io

A small package to provide tools to read / write and convert tabular data for DESC

LSSTDESC/tables_io Issues

Adding check_columns to check if a required column is present in the data
Updated 18 days ago
use lazy_modules for import of pa in types
Updated 2 months ago
Add generic concat and slice functionality
Closed 4 months ago1
Coverage report not being uploaded to Codecov
Updated 4 months ago1
Support Index files
Updated 4 months ago1
Use `match`
Updated 4 months ago2
`getGroupInputDataLength` runtime error
Updated 9 months ago
Add functionality to use input iterator in Rail for Parquet files
Closed 8 months ago
Have tables_io.read and readNative allow you to only read some tables in a file
Closed 4 months ago1
protect against empty groupname
Closed a year ago1
Apply RAIL-specific python project template
Closed a year ago1
Add iterator functionality for parquet files
Closed 4 months ago1
Add specific fuctions to effectively read parquet files
Closed a year ago1
Consider adding pyarrow and/ or numpy dicts format to list of supported formats for parquet files
Closed 4 months ago1
Set up optional deps in pyproject.toml. Manage unit tests to skip stuff that is missing.
Closed a year ago1
Support different suffixes for parquet files
Updated a year ago8
Add parallel implemantation to initializeHdf5WriteSingle
Closed a year ago
Add initializeHdf5WriteFromData to facilitate writing HDF5 files
Closed a year ago1
Extend supported input types types in writeDictToHdf5
Closed 2 years ago1
Add CSV to supported formats
Updated a year ago
switch to pyproject
Closed 2 years ago1
Bump python test matrix to 3.8, 3.9, 3.10
Closed 2 years ago1
Crashing with astropy 5.1
Closed 2 years ago1
Move mpi4py to tests_require from install_requires
Closed 2 years ago1
Allow initializeHdf5Write to open file in parallel mode
Closed 2 years ago
Add initializeHdf5WriteSingle and writeDictToHdf5ChunkSingle to handle case of writing only one table at the top level of and hdf5 file
Closed 2 years ago1
Add chunk write support to write several groups at once
Closed 2 years ago
Remove getDType and getData
Closed 2 years ago1
add getDType(data) function and use it to get the data type objects on lists
Closed 2 years ago1
Allow missing files when reading sets of parquet files
Closed 2 years ago1
Remove setuptools_scm from install_requires in setup.py
Closed 2 years ago1
Add conditional dependency for astropy when using py 3.7
Closed 3 years ago1
Add stuff that ceci/ rail will need
Closed 2 years ago1
Set up conditional dependency on pandas for py 3.7
Closed 3 years ago
Problem with lazyImport on MacOS if module is not already imported
Closed 2 years ago1
Add github action to push release to PyPi
Closed 3 years ago1
Add metadata support within tables_io
Updated 2 years ago
support numpy.recarray as a table format
Closed 2 years ago1
add utilities to manipulate dictionaries of numpy arrays.
Closed 3 years ago1
change iterate() functions to work with MPI
Closed 2 years ago2
allow read() function take sets of columns
Closed 4 months ago1
Add object that can collect a set of tables and provides unified IO support.
Closed 3 years ago1
Allow iterChunkHdf5Data to specify a subset of columns.
Updated a year ago
Add stuff from RAIL/fileIO.py
Closed 3 years ago1