dgraph-io / badger

Fast key-value DB in Go.

Home Page:https://dgraph.io/badger

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[FEATURE]: Data comparison between multiple badger instance

tangxusc opened this issue · comments

Have you tried Badger before this proposal? and did not find anything similar?

None

What you wanted to do.

background

When using Badger to build a distributed storage system, data in multiple unowned replication shards cannot be quickly compared

expect

Badger supports data comparison by key prefix for multiple instances

What you actually did.

No response

Why wasn't it great, with examples.

No response

Additional information.

No response

You can always iterate over two badger instances and figure out the differences between the two. Will that not work for you?

Is there a better way to use iterative methods to transmit key and value data across multiple distributed nodes that consume significant performance?

you could stream a snapshot and compare that, or compute a checksum (or another hash) and compare that.

I will try using Merkel tree to calculate abstracts and quickly compare them at different nodes. Thank you