[Enhancement] Reduce overall memory consumption and improve read speed.
koculu opened this issue · comments
Ahmed Yasin Koculu commented
To reduce the memory consumption of ZoneTree, consider the following optimizations:
- Convert byte arrays (
byte[]
) intoMemory<byte>
to eliminate unnecessary buffer copies. - Utilize
ArrayPool
for efficient memory management. - Enhance read block caches by replacing the unstable
CircularBlockCache
. - Pin iterators to single block cache to prevent multiple block caches from consuming memory during a table scan.
- Create and persist default sparse arrays upon disk segment creation.
- Implement key and value caches for each disk segment to minimize IO operations.
- Optimize the default configuration options.