paypal / dione

Dione - a Spark and HDFS indexing library

paypal/dione Issues

Any plan to upgrade the spark version to 3.3.0 ?
Closed a year ago
Occasional corruption of index
Updated a year ago5
Support for spark 3
Closed 2 years ago1
Fix Array type value when fetching from Parquet data
Updated 2 years ago
Record data_size column may have null issue
Closed 3 years ago2
Support time range query
Updated 3 years ago1
Add simple HTTP server implementation for fetches
Updated 3 years ago
Add support for ORC files
Closed 3 years ago
Add support for split files in all file formats
Updated 3 years ago
Any support for Delta files ?
Updated 3 years ago2
Support non-partitioned tables
Updated 3 years ago
Add IT script
Updated 3 years ago
Trim common hdfs prefix in index DF
Updated 3 years ago
Add missing partitions - add optional "min" partition
Updated 3 years ago
Consider datasource v2
Updated 3 years ago
Switch filesDF to HadoopRDD
Updated 3 years ago
Use Hadoop's file splits instead of start_pos,end_pos
Updated 3 years ago
ParquetIndexer currently doesn't support start_pos, end_pos
Updated 3 years ago
Add API to easily create AvroBtreeHash tables for non-index use cases
Updated 3 years ago
Add option to use IndexManager without Hive
Updated 3 years ago