high-throughput

There are 2 repositories under high-throughput topic.

FMInference / FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
deep-learning gpt-3 high-throughput large-language-models machine-learning offloading opt
Language:Python 9375
alphadose / ZenQ
A thread-safe queue faster and more resource efficient than golang's native channels
go golang lock-free low-latency memory-efficient ringbuffer thread-safe zero-allocations highly-concurrent mpsc-queue spsc-queue zenq concurrency fastest optimization high-throughput
Language:Go 690
salesforce / warp-drive
Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)
reinforcement-learning gpu cuda multiagent-reinforcement-learning deep-learning high-throughput pytorch numba
Language:Python 494
FMInference / H2O
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
gpt-3 heavy-hitters high-throughput kv-cache large-language-models sparsity
Language:Python 475
ByteDance-Seed / ShadowKV
[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
long-context low-rank sparse-attention llm-inference research cpu-offload high-throughput
Language:Python 269
materialsproject / atomate2
atomate2 is a library of computational materials science workflows
automation dft high-throughput materials-science vasp
Language:Python 249
quacc
Quantum-Accelerators / quacc
quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.
dft computational-materials-science quantum-chemistry quantum-mechanics database high-throughput workflow python chemistry hpc
Language:Python 230
JoyalAJohney / Realtime-distributed-chat
Realtime distributed messaging platform built using Go and React (Fullstack) ❤️
high-throughput low-latency realtime-messaging system-design
Language:Go 223
jnk0le / AVR-UART-lib
extremly light uart library for AVR 8 bit microcontrollers
avr avr-gcc uart usart prematured c high-speed low-overhead arduino-less transmission high-throughput flow-control optimized avr-microcontrollers rs232 rs485 avr-microcontroller
Language:C 108
tugrul512bit / LruClockCache
A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.
lru lru-cache low-latency caching clock-second-chance cpp least-recently-used memoization data-structures benchmark multi-level-cache direct-mapped-cache cache-simulator cache fast fastest high-performance high-throughput low-latency-queries set-associative-cache
Language:C++ 72
svenkubiak / mangooio
An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.
backend frontend fullstack high-throughput java performance undertow web-framework
Language:Java 59
RUB-Bioinf / VesselExpress
🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes
3d-imaging bioinformatics docker graph-analysis vessel-segmentation light-sheet-microscopy 3d-skeleton snakemake high-throughput
Language:Python 52
scalecube / reactor-aeron
A reactive driver for Aeron transport (https://github.com/real-logic/aeron)
aeron udp unicast multicast ipc rpc shared-memory low-latency high-throughput
Language:Java 49
dgruber / wfl
A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs
docker processes k8s workflow hpc macos linux high-throughput singularity kubernetes golang containers workflow-engine go
Language:Go 47
protocaller / ProtoCaller
Full automation of relative protein-ligand binding free energy calculations in GROMACS
free-energies gromacs ligand-binding molecular-dynamics-simulation python high-throughput
Language:Python 45
jmsadair / RapidTrader
A low-latency, high-throughput order matching system implementation.
concurrency cpp finance high-throughput low-latency matching-engine multithreading orderbook trading trading-platform
Language:C++ 44
MLSysU / TD-Pipe
A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models
high-throughput llm-inference pipeline-parallelism vllm
Language:Python 44
lsds / Saber
Window-Based Hybrid CPU/GPU Stream Processing Engine
stream-processing hybrid multicore gpu high-throughput saber stream streaming-data streaming sliding-windows multicore-cpu
Language:Java 42
zarp
zavolanlab / zarp
The Zavolab Automated RNA-seq Pipeline
bioinformatics conda docker fair high-throughput pipeline reproducible-research rna-seq singularity snakemake transcriptomics workflow
Language:Python 35
aretasg / dockit
High-throughput molecular docking with multiple targets and ligands using Vina series engines
vina autodock docking high-throughput computational-chemistry qvina smina docker flexible-residues pipeline
Language:Python 32
SINGROUP / matid
MatID is a python package for identifying and analyzing atomistic systems based on their structure. MatID is designed to help researchers in the automated analysis and labeling of atomistic datasets.
classification data-analysis high-throughput materials-science python
Language:Python 23
JuDFTteam / masci-tools
Post-processing toolkit for electronic structure calculations
electronic-structure materials-informatics visualization parsing utility band-structure computational-materials-science density-functional-theory density-of-states forschungszentrum-juelich high-throughput judft toolkit
Language:Python 18
andrewtarzia / mol-ellipsize
Molecular size calculation based on ellipsoid fitting over N conformers
chemistry molecules molecular-size high-throughput rdkit
Language:TeX 16
rustims
theGreatHerrLebert / rustims
A Framework for IMS-MS Raw Data Processing written in Rust and Python.
bottom-up data-independent-acquisition high-throughput ion-mobility-spectrometry mass-spectrometry omics proteomics pyo3 python raw-data rust-lang timstof
Language:Rust 16
JuDFTteam / aiida-fleur
AiiDA plugin of the high-performance density functional theory code FLEUR (www.judft.de) for high-throughput electronic structure calculations.
high-throughput workflow all-electron electronic-structure judft ab-initio aiida band-structure computational-materials-science condensed-matter-physics density-functional-theory forschungszentrum-juelich kohn-sham magnetism plane-wave spintronics full-potential
Language:Python 14
JuDFTteam / aiida-kkr
AiiDA plugin of the high-performance density functional theory code JuKKR (www.judft.de) for high-throughput electronic structure calculations.
kkr aiida workflow forschungszentrum-juelich electronic-structure multiple-scattering ab-initio all-electron band-structure coherent-potential-approximation computational-materials-science condensed-matter-physics defects density-functional-theory full-potential greens-functions high-throughput judft magnetism superconductivity
Language:Python 14
ldmtam / go-bitcask
A Log-Structured Hash Table for Fast Key/Value Data implemented in Golang
bitcask go high-throughput low-latency storage-engine
Language:Go 14
SlavovLab / plexDIA
Multiplexed data-independent acquisition (plexDIA) for increasing proteomics throughput. The code is distributed by an MIT license.
high-throughput mass-spectrometry proteomics-data-analysis single-cell multiplexed plexdia
Language:R 12
batch
elgopher / batch
Simple Go package for handling incoming requests in batches.
batch go golang high-performance high-throughput batch-processing
Language:Go 11
hpleva / pyemto
Run and manage EMTO-DFT calculations easily with this Python package
dft dft-calculations emto high-throughput hpc
Language:Python 11
httk / httk
The High-Throughput Toolkit (httk) is a toolkit for preparing and running calculations, analyzing the results, and storing the results and outcome in a global and/or in a personalized database.
high-throughput computations materials-science
Language:Python 11
andrewtarzia / MCHammer
Implementation of cheap Monte Carlo optimisation of bonds in molecules
high-throughput chemistry cheminformatics molecular-simulation optimization-algorithms
Language:Python 10
kai-tub / rico-hdl
A fast and easy-to-use Remote sensing Image format COnverter for High-throughput Deep-Learning (rico-hdl).
bigearthnet bigearthnet-mm bigearthnet-s1 bigearthnet-s2 converter data-loading deep-learning eurosat high-throughput hydro hyspecnet-11k major-tom-core remote-sensing ssl4eo-s12 uc-merced
Language:Python 10
alok7 / LMAXAbstractQueue
chronicle disruptor hft hft-trading high-frequency-trading high-performance high-throughput lmax lmax-disruptor lmax-exchange lockless low-latency market-data queue trading
Language:Java 9
YimingQiao / Fastest-Bloom-Filter
This is a library and benchmark for high throughput BloomFilters, including cache-sectorized BloomFilter.
bloom-filter cache-sectorized-bloom-filter high-throughput
Language:C++ 9
YttriLab / Joystick
Open-source joystick manipulandum for decision-making, reaching, and motor control studies in mice
joystick arduino reaching-task mouse-behavior neuroscience matlab processing decision-making high-throughput rodent-behaviors instrumental-conditioning
Language:C++ 9