FastFilter / xorfilter

Go library implementing binary fuse and xor filters

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Handle gracefully duplicated keys

lemire opened this issue · comments

Currently the user is responsible to ensure that there are no duplicated keys. We should handle this for the user (it is relatively easy to do efficiently, without even sorting). Try to construct the filter once (optimistically). The duplicated keys will be in the unmatched keys, just visit these keys.

The code won't fail badly if it happens: an error is returned and the user can take action.