cardinality-estimation

There are 5 repositories under cardinality-estimation topic.

alibaba / pilotscope
PilotScope is a middleware to bridge the gaps of deploying AI4DB (Artificial Intelligence for Databases) algorithms into actual database systems.
postgresql ai4db database middleware spark cardinality-estimation index-recommendation knob-tuning query-optimizer
Language:Python 156
ascv / HyperLogLog
Fast HyperLogLog for Python.
hyperloglog python cardinality-estimation cardinality-counter cardinality
Language:C 104
naru-project / naru
Neural Relation Understanding: neural cardinality estimators for tabular data
cardinality-estimation query-optimization self-supervised-learning generative-model unsupervised-learning deep-generative-model autoregressive-neural-networks learned-database-components learned-database density-estimation transformers
Language:Python 102
deepdb-public
DataManagementLab / deepdb-public
Implementation of DeepDB: Learn from Data, not from Queries!
approximate-query-processing cardinality-estimation learned-database learned-database-components machine-learning sum-product-networks
Language:Python 97
dynatrace-oss / hash4j
Dynatrace hash library for Java
murmur3 hash-functions hashing-algorithm non-cryptographic-hash-functions java hash wyhash hash-algorithm stream-processing hyperloglog cardinality-estimation data-sketches minhash superminhash simhash streaming-algorithms imohash jumphash farmhash consistent-hashing
Language:Java 95
bcgsc / ntCard
Estimating k-mer coverage histogram of genomics data
cardinality-estimation k-mer-counting k-mer-frequency hyperloglog streaming-algorithms
Language:C++ 77
neurocard / neurocard
State-of-the-art neural cardinality estimators for join queries
cardinality-estimation data-sampling deep-generative-model learned-database ml-for-systems probabilistic-models query-optimization self-supervised-learning transformers
Language:Python 76
oertl / hyperloglog-sketch-estimation-paper
Paper about the estimation of cardinalities from HyperLogLog sketches
cardinality-estimation data-sketches hyperloglog hyperloglog-sketches sketch-data-structures
Language:TeX 62
LiveRamp / HyperMinHash-java
Union, intersection, and set cardinality in loglog space
cardinality cardinality-estimation hyperloglog hyperloglog-sketches java loglog loglog-beta minhash
Language:Java 56
Wind-Gone / awesome-ai4db-paper
Paper related to AI4DB techniques
ai4db cardinality-estimation database index paper
56
dynatrace-research / set-sketch-paper
SetSketch: Filling the Gap between MinHash and HyperLogLog
sketch hyperloglog hyperloglog-sketches minhash minhash-lsh-algorithm minhash-sketches minhash-similarity jaccard-similarity jaccard intersection inclusion-exclusion estimation cardinality-estimation locality-sensitive-hashing minwise-hashing minwise-hashing-algorithm jaccard-similarity-estimation sketch-algorithm cosine-similarity sketch-data-structures
Language:C++ 49
pagegitss / UAE
A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation
cardinality-estimation machine-learning autoregressive-models gumbel-softmax monte-carlo-integration supervised-autoregressive-models deep-learning
Language:Python 27
waltercai / pqo-opensource
cardinality-estimation agm-bound entropic-bound sigmod query-optimization
Language:C 24
for0nething / FACE-A-Normalizing-Flow-based-Cardinality-Estimator
A pytorch implementation for FACE: A Normalizing Flow based Cardinality Estimator
cardinality-estimation deep-generative-model density-estimation learned-database learned-database-components normalizing-flow query-optimization unsupervised-learning
Language:Python 21
outbrain-inc / outrank
A Python library for efficient feature ranking and selection on sparse data sets.
data-mining data-monitoring data-stream-mining feature-ranking feature-selection online-feature-building python-library scalable-machine-learning algorithms counting machine-learning probabilistic-programming statistics numba-jit-compiler cardinality-estimation multithreaded online-learning-algorithms feature-engineering sampling-methods
Language:Python 21
cloudflare / cardinality-estimator
A crate for estimating the cardinality of distinct elements in a stream or dataset.
cardinality-estimation distinct-elements hyperloglog sketches probalistic-data-structures
Language:Rust 19
mikeheddes / fast-multi-join-sketch
Fast Cardinality Estimation of Multi-Join Queries Using Sketches
cardinality-estimation sketching-algorithm
Language:Python 15
lucaswo / cardest
Code for Local Deep Learning Models for Cardinality Estimation
cardinality-estimation machine-learning
Language:Python 11
surajiyer / Database-SQL-joins-algorithm
An implementation of the algorithms presented in the paper "Cardinality Estimation Done Right: Index-Based Join Sampling"
sql joins cardinality-estimation pandas-dataframe
Language:Python 9
sykwon / teddy-dream
[VLDB'22] Cardinality Estimation of Approximate Substring Queries using Deep Learning.
cardinality-estimation data-generation deep-learning similarity-search substring-search
Language:Python 9
dynatrace-research / exaloglog-paper
ExaLogLog: Space-Efficient and Practical Approximate Distinct Counting up to the Exa-Scale
count-distinct data-sketches data-sketching hyperloglog sketch cardinality-estimation data-structures hll-algorithm
Language:Java 8
dynatrace-research / ultraloglog-paper
UltraLogLog: A Practical and More Space-Efficient Alternative to HyperLogLog for Approximate Distinct Counting
count-distinct hyperloglog ultraloglog cardinality cardinality-estimation data-sketches data-sketching probabilistic-data-structures
Language:Python 8
var-skip / var-skip
Code for variable skipping ICML 2020 paper
deep-generative-model self-supervised-learning autoregressive-neural-networks density-estimation pattern-matching learned-database cardinality-estimation
Language:Python 7
wurenzhi / learned_ndv_estimator
Learned model to estimate number of distinct values (NDV) of a population using a small sample.
cardinality-estimation number-of-distinct-values
Language:Python 7
Asoke26 / Simpli-Squared
Simpli-Squared is a statistics-free join ordering algorithm Without Cardinality Estimates.
database query-optimization join-ordering physical-operators postgresql cardinality-estimation
Language:Python 6
OnizukaLab / Scardina
Scalable Join Cardinality Estimaitor
cardinality-estimation deep-learning query-optimization
Language:Python 6
preciz / talan
Probabilistic data structures (bloom filter / counting bloom filter / linear counter)
bloom-filter cardinality-estimation membership
Language:Elixir 6
Wind-Gone / ai4db-datasets
Datasets Used in AI4DB Research Work
ai4db cardinality-estimation database queryoptimization
6
jlumbroso / affirmative-sampling
Reference implementation of the Affirmative Sampling algorithm by Jérémie Lumbroso and Conrado Martínez (2022). 🍀
cardinality-estimation data-streaming random-sampling affirmative-sampling probabilistic-algorithm
Language:Python 5
ethantrott / hyperloglog-estimation
python implementations of the Flajolet-Martin, LogLog, SuperLogLog, and HyperLogLog cardinality estimation algorithms, specifically used to estimate the cardinality of unique traffic violations in NYC in the 2019 fiscal year
cardinality-estimation flajolet-martin hyperloglog loglog python-implementations superloglog
Language:Python 4
Wind-Gone / STAT-Ai4CardinalityEstimation-CodeBase
Current STAT Learning-based Cardinality Estimation Code Base
ai4db cardinality-estimation database
Language:C 4
lucaswo / queryfeaturizations
Updated code for different query featurizations for MSCN
cardinality-estimation featurization machine-learning
Language:Python 3
martinkiefer / feedback-kde
Self-Tuning GPU-Accelerated Kernel Density Estimators
opencl postgresql database optimization c cardinality-estimation
Language:C 3
AnalyticsMesh
asjadsyed / AnalyticsMesh
Distributed Cardinality Tracking
cardinality-estimation crdt distributed-systems hyperloglog
Language:Python 2
gene-hll
esalini22 / gene-hll
HyperLogLog en C++ y OpenMP para cálculo de similitud de genomas mediante índice de Jaccard
cardinality-estimation count-distinct cpp genomics hyperloglog jaccard-distance jaccard-index jaccard-similarity jaccard-similarity-estimation kmer openmp parallel-computing parallel-programming probabilistic-data-structures stream-processing streaming-algorithms
Language:C++ 2
TechArena-Track-2
omung789 / TechArena-Track-2
Submission for Huawei European University Challenge 2024 Team: Knee Surgery Place: 15th
cardinality-estimation cpp
Language:C++ 1

cardinality-estimation

alibaba / pilotscope

ascv / HyperLogLog

naru-project / naru

DataManagementLab / deepdb-public

dynatrace-oss / hash4j

bcgsc / ntCard

neurocard / neurocard

oertl / hyperloglog-sketch-estimation-paper

LiveRamp / HyperMinHash-java

Wind-Gone / awesome-ai4db-paper

dynatrace-research / set-sketch-paper

pagegitss / UAE

waltercai / pqo-opensource

for0nething / FACE-A-Normalizing-Flow-based-Cardinality-Estimator

outbrain-inc / outrank

cloudflare / cardinality-estimator

mikeheddes / fast-multi-join-sketch

lucaswo / cardest

surajiyer / Database-SQL-joins-algorithm

sykwon / teddy-dream

dynatrace-research / exaloglog-paper

dynatrace-research / ultraloglog-paper

var-skip / var-skip

wurenzhi / learned_ndv_estimator

Asoke26 / Simpli-Squared

OnizukaLab / Scardina

preciz / talan

Wind-Gone / ai4db-datasets

jlumbroso / affirmative-sampling

ethantrott / hyperloglog-estimation

Wind-Gone / STAT-Ai4CardinalityEstimation-CodeBase

lucaswo / queryfeaturizations

martinkiefer / feedback-kde

asjadsyed / AnalyticsMesh

esalini22 / gene-hll

omung789 / TechArena-Track-2