parallel-processing

There are 11 repositories under parallel-processing topic.

jobrunr / jobrunr
An extremely easy way to perform background processing in Java. Backed by persistent storage. Open and free for commercial use.
background-jobs java java-8 java-scheduler parallel-processing quartz scheduled-jobs scheduler scheduling
Language:Java 2288
wagoodman / bashful
Use a yaml file to stitch together commands and bash snippits and run them with a bit of style. Why? Because your bash script should be quiet and shy-like (...and not such a loud mouth).
bash build-tool golang installer parallel-processing pretty progress-bar yaml
Language:Go 1149
envpool
sail-sg / envpool
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
atari-games box2d cpp17 dm-control dm-env gym high-performance-computing lock-free-queue mujoco parallel-processing pybind11 reinforcement-learning reinforcement-learning-environments robotics threadpool vizdoom
Language:C++ 1049
future
HenrikBengtsson / future
:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone
asynchronous cran distributed-computing futures hpc hpc-clusters parallel-computing parallel-processing parallelization programming promises r
Language:R 947
fastai / fastcore
Python supercharged for the fastai library
data-structures developer-tools dispatch documentation-generator fastai functional-programming languages parallel-processing python
Language:Jupyter Notebook 912
esa / pagmo2
A C++ platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.
artificial-intelligence evolutionary-algorithms evolutionary-strategy genetic-algorithm metaheuristics multi-objective-optimization optimization optimization-algorithms optimization-methods optimization-tools pagmo parallel-computing parallel-processing python python3 stochastic-optimizers
Language:C++ 808
amphp / parallel
An advanced parallelization library for PHP, enabling efficient multitasking, optimizing resource use, and application responsiveness through multiple CPU threads.
concurrency multiprocessing php parallel-processing amphp parallel revolt
Language:PHP 762
austinksmith / Hamsters.js
100% Vanilla Javascript Multithreading & Parallel Execution Library
multithreading parallel-processing big-data concurrent-programming cross-platform future-proofing high-performance-computing innovation javascript-library multithreaded nodejs-server open-source optimization react-native-app scalability task-processor threadpool web-application
Language:JavaScript 569
swansonk14 / p_tqdm
Parallel processing with progress bars
parallel-processing progress-bar tqdm
Language:Python 445
esa / pygmo2
A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.
artificial-intelligence evolutionary-algorithms evolutionary-computation evolutionary-strategy island-model meta-heuristic meta-heuristics multiobjective-optimization optimization optimization-algorithms optimization-methods optimization-problem parallel-computing parallel-processing stochastic-optimization
Language:C++ 417
FILTER.js
foo123 / FILTER.js
Video and Image Processing and Computer Vision Library in pure JavaScript (Browser and Node.js)
image-processing video-processing computer-vision machine-learning node-js browser glsl parallel-processing webgl real-time wasm web-assembly
Language:JavaScript 388
lehins / massiv
Efficient Haskell Arrays featuring Parallel computation
haskell array arrays stencil multidimensional-arrays convolution parallel-computing parallel-processing haskell-arrays massiv massiv-io delayed-arrays
Language:Haskell 383
BabelStream
UoB-HPC / BabelStream
STREAM, for lots of devices written in many programming models
memory-bandwidth benchmark parallel-processing gpgpu opencl cuda kokkos raja sycl openmp openacc hpc gpu
Language:C++ 316
multithreading
W4G1 / multithreading
⚡ Multithreading functions in JavaScript to speedup heavy workloads, designed to feel like writing vanilla functions.
es6-generators multithreading threads webworkers worker-threads concurrency javascript multi-threading nodejs parallel-processing typescript web-worker web-workers shared-worker worker-pool
Language:TypeScript 304
lilydjwg / pssh
Parallel SSH Tools
pssh ssh parallel-processing batch-processing
Language:Python 274
HenrikBengtsson / future.apply
:rocket: R package: future.apply - Apply Function to Elements in Parallel using Futures
r package future parallel parallel-computing parallel-processing distributed-computing asynchronous hpc hpc-clusters programming parallelization
Language:R 206
WZBSocialScienceCenter / tmtoolkit
Text Mining and Topic Modeling Toolkit for Python with parallel processing power
topic-modeling text-processing evaluation parallel-processing nlp socialscience python
Language:Python 193
lvyahui8 / spring-boot-data-aggregator
基于注解实现并行地依赖注入（数据聚合），可以看做 Spring Async 注解的升级版
data-aggregation spring-boot bean-mapping parallel-processing concurrency
Language:Java 178
hxz393 / BrutalityExtractor
适用于高性能系统的多进程解压缩软件(A multiprocess decompression software for high-performance system)
brute-force computational-efficiency data-processing decompression extractor high-performance optimization parallel-computing parallel-processing performance-optimization scalable brute-force-techniques performance-enhancement brute-force-decompression high-speed-decompression parallel-decompression parallel-optimization brute-force-attack efficient-compression-tool performance-testing
Language:Python 171
eXascaleInfolab / PyExPool
Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture
multiprocessing parallel-computing execution-pool cache-control numa load-balancing in-memory-computations task-queue parallel-processing application-framework benchmarking-framework monitoring-server
Language:Python 164
eBay / accelerator
The Accelerator is a tool for fast and reproducible processing of large amounts of data.
data-science data-mining data-engineering parallel-processing reproducibility high-performance-computing big-data
Language:Python 150
zllangct / ecs
A Go-implementation of the ECS (Entity-Component-System), focus on the development of game server.
ecs entity-component-system game game-development game-server parallel-processing parallel-programming
Language:Go 127
joe-habel / YouTube-View-Bot
A rotating proxy solution to bot YouTube views
web-crawler parallel-processing
Language:Python 93
in-op / GameAI
Various C# implementations of game AI
artificial-intelligence monte-carlo monte-carlo-tree-search game-ai multithreading parallel-processing minimax minimax-algorithm monte-carlo-simulation
Language:C# 79
Leopard
hosseinmoein / Leopard
C++ light-weight Thread Pool library
async cpp multithreading thread-pool threading threadpool parallel-computing parallel-programming parallel-processing concurrency concurrent-programming
Language:C++ 76
BY571 / IQN-and-Extensions
PyTorch Implementation of Implicit Quantile Networks (IQN) for Distributional Reinforcement Learning with additional extensions like PER, Noisy layer, N-step bootstrapping, Dueling architecture and parallel env support.
iqn distributional-r rainbow reinforcement-learning-algorithms reinforcement-learning dqn pytorch-implementation implicit-quantile-networks noisy-layer n-step-bootstrapping prioritized-experience-replay munchausen pytorch parallel-computing parallel-processing multi-environment
Language:Jupyter Notebook 75
jppf-grid / JPPF
The open source grid computing solution
grid-computing parallel-processing grid-middlewares cloud-computing jppf volunteer-computing distributed-computing distributed-systems hpc kubernetes docker
Language:Java 63
HenrikBengtsson / future.callr
:rocket: R package future.callr: A Future API for Parallel Processing using 'callr'
asynchronous futures parallel-computing parallel-processing parallelization programming promises r
Language:R 62
QRCS-CORP / CEX
The CEX Cryptographic library in C++
cryptography aes serpent twofish ring-lwe mceliece prng mac keccak blake2 sha2 skein key-exchange-algorithms lattice-based-crypto post-quantum-cryptography parallel-processing avx avx2 avx512 cex
Language:HTML 62
yapp
picanumber / yapp
A parallel pipeline for stream processing
cpp cpp20 header-only multithreading parallel-processing pipeline template-metaprogramming
Language:C++ 59
canbula / ParallelProgramming
Repository for Parallel Programming course given by Assoc. Prof. Dr. Bora Canbula at Computer Engineering Department of Manisa Celal Bayar University.
asynchronous-programming asyncio parallel-processing parallel-programming processing python python3 threading multiprocessing
Language:Python 58
hypergol / hypergol
Hypergol is a Data Science/Machine Learning productivity toolkit to accelerate any projects into production with autogenerated code, standardised structure for data and ML and parallel processing out-of-the-box.
machine-learning data-science performance code-generation parallel-processing data-modelling deep-learning deployment
Language:Python 53
DidactHQ / didact-engine
The REST API and execution engine for the Didact Platform.
data-engineering data-pipelines dotnet dotnet-standard orchestrator parallel-processing pipelines rest-api workflow workflow-engine data-orchestrator background-jobs
Language:C# 52
techytoes / Parallel-Programming-Coursera
Assignments and Quizzes submitted by me.
coursera parallel-computing parallel-programming parallel-processing java-8 forkjoin rice-university
Language:Java 49
Breakend / MotionDetection
A project on motion detection in a noisy environment (shaky or moving camera), through background subtraction with single Gaussian models.
parallel-processing c-plus-plus cuda motion-detection
Language:C++ 47
UWHustle / hustle
In-memory, columnar, arrow-based database.
database columnar apache-arrow sqlite parallel-processing olap htap in-memory-database
Language:C++ 41