kelindar / column

High-performance, columnar, in-memory store with bitmap indexing in Go

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can Collection object be serialized?

didip opened this issue · comments

I am thinking of serializing it into BadgerDB. Is there a safe mechanism to do so?

Snapshots aren't supported right now, but I've been thinking of implementing it. Only thing supported is CDC via a transaction commit log, which can be used for durability purposes and replayed to create a read replica.

Do keep in mind tho, the API of this project isn't stable yet and will change in the future (guaranteed) - hence it's not yet versioned.

Fyi, I merged the snapshotting today (see #39), there's still some work to be done to merge/reconcile incomplete transactions in case the snapshot happens concurrently with new writes, but most of the stuff should work.