streaming-algorithms

There are 8 repositories under streaming-algorithms topic.

miller
johnkerl / miller
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit
Language:Go 9137
Waikato / moa
MOA is an open source framework for Big Data stream mining. It includes a collection of machine learning algorithms (classification, regression, clustering, outlier detection, concept drift detection and recommender systems) and tools for evaluation.
clustering data-stream-mining java machine-learning machine-learning-algorithms moa streaming-algorithms
Language:Java 624
ast-al / rangeless
c++ LINQ -like library of higher-order functions for data manipulation
cpp cpp11 functional functional-programming itertools lazy-evaluation linq parallel pipeline range streaming-algorithms streaming-data
Language:C++ 194
dynatrace-oss / hash4j
Dynatrace hash library for Java
murmur3 hash-functions hashing-algorithm non-cryptographic-hash-functions java hash wyhash hash-algorithm stream-processing hyperloglog cardinality-estimation data-sketches minhash superminhash simhash streaming-algorithms imohash jumphash farmhash consistent-hashing
Language:Java 96
alecmocatta / streaming_algorithms
Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.
data-structures hyperloglog probabilistic-data-structures rust streaming-algorithms
Language:Rust 85
bcgsc / ntCard
Estimating k-mer coverage histogram of genomics data
cardinality-estimation k-mer-counting k-mer-frequency hyperloglog streaming-algorithms
Language:C++ 76
cmdevries / LMW-tree
Learning M-Way Tree - Web Scale Clustering - EM-tree, K-tree, k-means, TSVQ, repeated k-means, bitwise clustering
bit-vectors clustering-algorithm hierarchical-clustering k-means-clustering large-scale-learning locality-sensitive-hashing random-indexing random-projections streaming-algorithms
Language:C++ 74
usmanm / redis-tdigest
t-digest module for Redis
redis tdigest redis-module quantile redis-tdigest streaming-algorithms percentile
Language:C 73
andylamp / federated_pca
Federated Principal Component Analysis Revisited!
pca streaming federated-learning decentralized streaming-algorithms online-learning subspace-tracking differential-privacy perturbation-mask principal-components federated-pca dimensionality-reduction
Language:MATLAB 39
LaurentRDC / npstreams
Streaming operations on NumPy arrays
numpy python3 streaming-algorithms
Language:Python 35
alexander-yu / stream
An online statistics library, written in Go
data-structures go golang online-algorithms statistics stats streaming-algorithms
Language:Go 32
bmoscon / StreamingAlgorithms
A Set of Streaming Algorithms in C++, Python, and Go
c-plus-plus cpp go golang python streaming-algorithms
Language:C++ 32
dccuchile / rivertext
RiverText is a framework that standardizes the Incremental Word Embeddings proposed in the state-of-art. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!
incremental-learning nlp-machine-learning streaming-algorithms streaming-data online-learning pytorch-nlp cbow skipgram-algorithm wordembeddings
Language:Python 22
andylamp / moses
Streaming, Memory-Limited, r-truncated SVD Revisited!
streaming streaming-algorithms svd pca dimensionality-reduction online-algorithms subspace-learning subspace-tracking subspace-identification
Language:MATLAB 21
Shamir-Lab / Faucet
This is the codebase for Faucet, described in our manuscript: https://academic.oup.com/bioinformatics/article/34/1/147/4004871, by Roye Rozov, Gil Goldshlager, Eran Halperin, and Ron Shamir
de-novo-assembly metagenomes streaming-algorithms
Language:C++ 18
MikeJaredS / hermiter
Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Nonparametric Correlation (Bivariate)
online-algorithms streaming-algorithms streaming-data statistics quantile probability-density-function cumulative-distribution-function spearman-correlation-coefficient kendall-correlation-coefficient
Language:R 15
hishamcse / Data-Structures-and-Algorithms-Specialization
This repository contains all the solutions of assignments, starter files and other materials related to this specialization.
data-structures algorithms greedy-algorithms divide-and-conquer dynamic-programming graph-algorithms string-algorithms suffix-trees genome-assembly debruijn-graph streaming-algorithms sorting-algorithms searching-algorithms linear-programming maxflow shortest-paths minimum-spanning-trees np-completeness burrows-wheeler-transform sat
Language:Java 9
jlumbroso / python-random-hash
A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister. 🎲
data-streaming flajolet flajolet-martin hash-functions hyperloglog python analysis-of-algorithms analytic-combinatorics randomized-algorithm streaming-algorithms
Language:Python 9
sjorek / mediacastsegmenter
Create MPEG2-TS encapsulated stream-segments.
c http mpeg2 streaming streaming-video streaming-algorithms
Language:C 8
SebastianSchmidl / pyonlinesvr
Python-Wrapper for Francesco Parrella's OnlineSVR C++ implementation with scikit-learn-compatible interface.
python numpy scikit-learn svr online streaming-algorithms onlinesvr python3 machine-learning cpp
Language:C++ 6
statsim / preview
Preview large text files online
webapp streaming-algorithms
Language:HTML 5
AmoliR / rank1-svd-update
Updating Singular Value Decomposition (SVD) for rank-1 perturbed matrix.
fast-multipole-method matrix-factorization matrix-multiplication online-algorithms rank1-updates singular-value-decomposition streaming-algorithms
Language:MATLAB 4
csieber / pydashsim
Simulates a HTTP Adaptive Streaming (HAS) session based on a throughput pattern and video segment sizes.
has streaming streaming-algorithms
Language:Python 4
panagiotisl / CoEuS
CoEuS: Community Detection via Seed-set Expansion on Graph Streams
community-detection-algorithm graph-algorithms streaming-algorithms streaming-graph-processing
Language:Java 4
adriacabeza / ComplexAlgorithms
🧙🏾‍♂️ Complex Algorithms and Complexity Course from the University of San Diego
algorithm complexity flow-networks linear-programming np-completeness streaming-algorithms python3
Language:Python 3
DynoGraph / stinger-dynograph
DynoGraph benchmark suite, implemented using the STINGER graph engine
graph benchmark streaming-algorithms stinger
Language:C 3
ocramz / optimization-streaming
optimization numerical-optimization numerical-methods streaming-algorithms streaming-data stochastic-gradient-descent
Language:Haskell 3
statsim / profile
Profile. Generate data profiles in the browser (work in progress)
data-profiling data-profile statistics streaming-algorithms online-algorithms
Language:JavaScript 3
thanhtbt / aFAPI
[IEEE ICASSP 2023] "Robust Subspace Tracking with Contamination Mitigation via Alpha-Divergence". In 48th IEEE International Conference on Acoustics, Speech, & Signal Processing, 2023.
contamination non-gaussian outliers robust-algorithm subspace-tracking streaming-algorithms
Language:MATLAB 3
gene-hll
esalini22 / gene-hll
HyperLogLog en C++ y OpenMP para cálculo de similitud de genomas mediante índice de Jaccard
cardinality-estimation count-distinct cpp genomics hyperloglog jaccard-distance jaccard-index jaccard-similarity jaccard-similarity-estimation kmer openmp parallel-computing parallel-programming probabilistic-data-structures stream-processing streaming-algorithms
Language:C++ 2
MDanish99 / Misra-Gries-Frequent-Patterns
Misra-Gries algorithm for frequent pattern mining.
frequent-pattern-mining misra-gries streaming-algorithms
Language:Jupyter Notebook 2
rahulptel / aobd17
streaming-algorithms optimization streaming-data decomposition generative-adversarial-network robust-pca linear-discriminant-analysis incremental-pca online-regression online-singular-value-decomposition probabilistic-pca expectation-maximization
2
babakyousefian / Virtual-Reality
you can learning operating midwife in operate room in VR hospital within AI robots for the first time in all around the world
algorithms-datastructures ant-colony-algorithm artificial-intelligence-algorithms classification-algorithm cnn-classification csharp-script deep-reinforcement-learning handtracking haptic-feedback hog localization object-detection r-cnn single-shot-multibox-detector steam-api steamvr streaming-algorithms touchpad virtual-reality yoloalgoritms
Language:C# 1
drewm8080 / data_mining_streaming_data
A project for streaming algorithms: Bloom filtering, Flajolet-Martin Algorithm, Fixed-Size Sampling
datamining-algorithms streaming-algorithms
Language:Python 1
Erfanm83 / delivery-fare-estimation
a delivery fare estimation script that also filters out suspicious deliveries and incorrect data entries due to faulty GPS devices.
big-data csv-reading delivery-service golang learn streaming-algorithms
Language:Go 1
vojtechgadurek / SimpleSetSketching
Bachelor thesis - a implementation of streaming algorithms for finding symetric difference of very large and very similar sets
implementation streaming-algorithms test
Language:C# 1