hyperloglog

There are 5 repositories under hyperloglog topic.

ekzhu / datasketch
MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
data-sketches data-summary hnsw hyperloglog jaccard-similarity locality-sensitive-hashing lsh lsh-ensemble lsh-forest minhash python search top-k weighted-quantiles
Language:Python 2803
axiomhq / hyperloglog
HyperLogLog with lots of sugar (Sparse, LogLog-Beta bias correction and TailCut space reduction) brought to you by Axiom
axiom data-structures go golang hyperloglog
Language:Go 1014
Callidon / bloom-filters
JS implementation of probabilistic data structures: Bloom Filter (and its derived), HyperLogLog, Count-Min Sketch, Top-K and MinHash
bloom-filter probabilistic cuckoo-filter count-min-sketch javascript invertible-bloom-filter hyperloglog topk minhash
Language:TypeScript 427
youzan / ZanRedisDB
Yet another distributed fault-tolerant key-value database Compatible with Redis written in Golang.
distributed-database geohash hyperloglog json key-value kvstore raft redis rocksdb sharding
Language:Go 393
fcambus / logswan
Fast Web log analyzer using probabilistic data structures
web log analyzer hyperloglog
Language:C 390
axiomhq / hyperminhash
HyperMinHash: Bringing intersections to HyperLogLog
estimation hyperloglog
Language:Go 306
thepirat000 / CachingFramework.Redis
Distributed caching based on StackExchange.Redis and Redis. Includes support for tagging and is cluster-compatible.
redis redis-client redis-cluster serialization redis-api keyspace-notifications-api redis-command tagging pubsub ttl ttl-cache cache geospatial lexicographical hyperloglog netcore
Language:C# 296
svpcom / hyperloglog
Hyper LogLog (native and sliding) cardinality counters
cardinality cardinality-counter cardinality-estimation hyperloglog hyperloglogplus python
Language:Python 240
dnbaker / dashing
Fast and accurate genomic distances using HyperLogLog
sketch-data-structures metagenomics indexing hyperloglog
Language:C++ 162
dnbaker / sketch
C++ Implementations of sketch data structures with SIMD Parallelism, including Python bindings
hll sketch-data-structures hyperloglog bloom-filter count-min-sketch minhash
Language:C++ 155
bigmlcom / sketchy
Sketching Algorithms for Clojure (bloom filter, min-hash, hyper-loglog, count-min sketch)
hashing sketching bloom-filter minhash count-min-sketch hyperloglog clojure
Language:Clojure 149
dynatrace-oss / hash4j
Dynatrace hash library for Java
murmur3 hash-functions hashing-algorithm non-cryptographic-hash-functions java hash wyhash hash-algorithm hyperloglog cardinality-estimation data-sketches minhash superminhash simhash streaming-algorithms imohash jumphash farmhash consistent-hashing xxh3
Language:Java 125
ascv / HyperLogLog
Fast HyperLogLog for Python.
hyperloglog python cardinality-estimation cardinality-counter cardinality
Language:C 110
alecmocatta / streaming_algorithms
Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.
data-structures hyperloglog probabilistic-data-structures rust streaming-algorithms
Language:Rust 88
mattlorimor / ProbabilisticDataStructures
A probabilistic data structures library for C#
csharp c-sharp probabilistic-data-structures bloom-filter cuckoo-filter count-min-sketch stable-bloom-filters counting-bloom-filters scalable-bloom-filters hyperloglog
Language:C# 80
absolute8511 / ZanRedisDB
Yet another distributed fault-tolerant key-value database Compatible with Redis written in Golang.
raft kvstore redis sharding distributed-database secondary-index key-value rocksdb json geohash hyperloglog
Language:Go 79
bcgsc / ntCard
Estimating k-mer coverage histogram of genomics data
cardinality-estimation k-mer-counting k-mer-frequency hyperloglog streaming-algorithms
Language:C++ 76
oertl / hyperloglog-sketch-estimation-paper
Paper about the estimation of cardinalities from HyperLogLog sketches
hyperloglog cardinality-estimation sketch-data-structures data-sketches hyperloglog-sketches
Language:TeX 64
retailnext / hllpp
HyperLogLog cardinality estimation algorithm in go/golang!
go hyperloglog golang awesome dinosaur
Language:Go 60
LiveRamp / HyperMinHash-java
Union, intersection, and set cardinality in loglog space
cardinality cardinality-estimation java loglog hyperloglog hyperloglog-sketches loglog-beta minhash
Language:Java 57
wangyi-fudan / wyHLL
The dream accurate approximate set cardinality estimator based on 3-bit HyperLogLog. More accurate than Redis HyperLogLog.
accurate hyperloglog cardinality minimalist
Language:C 55
jedisct1 / rust-hyperloglog
A HyperLogLog implementation in Rust.
rust hyperloglog sketching
Language:Rust 51
dynatrace-research / set-sketch-paper
SetSketch: Filling the Gap between MinHash and HyperLogLog
sketch hyperloglog hyperloglog-sketches minhash minhash-lsh-algorithm minhash-sketches minhash-similarity jaccard-similarity jaccard intersection inclusion-exclusion estimation cardinality-estimation locality-sensitive-hashing minwise-hashing minwise-hashing-algorithm jaccard-similarity-estimation sketch-algorithm cosine-similarity sketch-data-structures
Language:C++ 48
tomtomwombat / hyperloglockless
Lightning fast concurrent HyperLogLog for Rust.
cardinality-estimation concurrent hyperloglog hyperloglogplus probabilistic sketch
Language:Rust 42
travisbrady / flajolet
Probabilistic data structures for OCaml
flajolet ocaml hyperloglog minhash bloom-filter hyperlog
Language:OCaml 39
datasketches
Query-farm / datasketches
Integrates DuckDB with the high-performance Apache DataSketches library. This extension enables users to perform approximate analytics on large-scale datasets using state-of-the-art streaming algorithms, all from within DuckDB.
bloomfilter datasketches duckdb duckdb-extension hyperloglog probalistic-data-structures
Language:C++ 35
andy2046 / gopie
go patterns
golang patterns lru barrier consistent-hashing semaphore pubsub singleton subsetting drf skiplist bloom-filter hyperloglog count-min-sketch
Language:Go 33
sqlog
nidorx / sqlog
SQLog - Connecting the dots
bloom-filter golang hyperloglog logging lsm-tree observability sqlite
Language:Go 33
jean-pierreBoth / probminhash
Rust implementation of probminhash, superminhash and hyperloglog sketching algorithms
hyperloglog probminhash sketching
Language:Rust 30
sasha-s / go-hll
HyperLogLog in golang
golang hll hyperloglog
Language:Go 26
cloudflare / cardinality-estimator
A crate for estimating the cardinality of distinct elements in a stream or dataset.
cardinality-estimation distinct-elements hyperloglog sketches probalistic-data-structures
Language:Rust 25
davidesantangelo / hyll
A Ruby implementation of the HyperLogLog algorithm for efficient cardinality estimation with minimal memory footprint. Count millions of distinct elements using only kilobytes of memory.
alghoritms counting-distinct-elements hyperloglog presto ruby
Language:Ruby 25
tabac / hyperloglog.rs
HyperLogLog implementations.
hyperloglog hyperloglogplus probabilistic
Language:Rust 25
shabbyrobe / phphll
HyperLogLog for PHP implemented as a C extension
php hyperloglog php-extension
Language:C 20
matoous / visigo
Unique site visits counter in Go
golang middleware unique-visitors hyperloglog
Language:Go 19
jianshu93 / lash
Fast and Memory Efficient Genome Sketching via HyperLogLog, HyperMinHash and UltraLogLog
average-nucleotide-identity cardinality-estimation metagenome streaming-algorithms genome-sketching hyperloglog hyperloglogplus ultraloglog hyperminhash
Language:Rust 17