distributed-machine-learning

There are 7 repositories under distributed-machine-learning topic.

distributed-ml-patterns
terrytangyuan / distributed-ml-patterns
Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo
machine-learning distributed-systems cloud-computing cloud-native distributed-machine-learning large-scale-machine-learning python tensorflow kubernetes argo-workflows kubeflow machine-learning-pipelines manning-publications book data-science devops mlops argo
Language:Python 316
ray-project / ray-educational-materials
This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
deep-learning distributed-machine-learning ray-distributed ray-tune ray ray-train ray-data ray-serve generative-ai llm llm-inference llm-serving
Language:Jupyter Notebook 282
diaoenmao / HeteroFL-Computation-and-Communication-Efficient-Federated-Learning-for-Heterogeneous-Clients
[ICLR 2021] HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients
deep-learning federated-learning model-compression distributed-machine-learning
Language:Python 127
INET-RC / GeoMX
GeoMX: A fast and unified system for distributed machine learning over geo-distributed data centers.
communication-efficient distributed-machine-learning dml-over-wans hierarchical-parameter-server geomx
Language:C++ 114
anupamkliv / FedERA
FedERA is a modular and fully customizable open-source FL framework, aiming to address these issues by offering comprehensive support for heterogeneous edge devices and incorporating both standalone and distributed computing. It includes new software modules to enhance usability and promote environ- mental sustainability.
carbon-emissions deep-learning distributed-machine-learning edge-devices federa federated-learning framework grpc python pytorch
Language:Jupyter Notebook 109
PaddlePaddle / PaddleDTX
Paddle with Decentralized Trust based on Xuperchain
decentralized-storage distributed-machine-learning trusted-ai federated-learning blockchain
Language:Go 87
monk1337 / Aweome-Heathcare-Federated-Learning
A curated list of Federated Learning papers/articles and recent advancements.
artifical-intelligense awesome-list awesome-machine-learning blockchain-medical-applications data-privacy deep-learning deep-learning-healthcare distributed-machine-learning federated-learning healthcare-data healthcare-datasets healthcare-federated-learning healthcare-imaging life-science-data machine-learning machine-learning-healthcare machine-learning-privacy medical-data-pipeline non-iid vertical-federated-learning
70
sensAI
GuanhuaWang / sensAI
sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data
machine-learning distributed-systems cifar10 cifar100 imagenet1k cnn-classification sysml deep-neural-networks deep-learning distributed-deep-learning distributed-machine-learning vgg resnet shufflenet-v2 mobilenet-v2 mlsys cifar-10 cifar-100 imagenet
Language:Python 62
cleanzr / dblink
Distributed Bayesian Entity Resolution in Apache Spark
entity-resolution apache-spark bayesian-inference record-linkage distributed-machine-learning mcmc
Language:Scala 54
orion-orion / FedAO
🔨 A toolbox for federated learning, aiming to provide implementations of FedAvg, FedProx, Ditto, etc. in multiple versions, such as Pytorch/Tensorflow, single-machine/distributed, synchronized/asynchronous.
federated-learning distributed-machine-learning machine-learning
Language:Python 49
mls
pooyanjamshidi / mls
CSCE 585 - Machine Learning Systems
machine-learning computer-systems distributed-machine-learning machine-learning-systems
Language:TeX 37
xinyandai / gradient-quantization
vector quantization for stochastic gradient descent.
gradient-quantization gradient-compression sgd federated-learning distributed-machine-learning
Language:Python 33
makgyver / gossipy
Python module for simulating gossip learning.
gossip-learning gossip-protocol federated-learning simulation pytorch distributed-machine-learning deep-learning
Language:Python 28
diaoenmao / SemiFL-Semi-Supervised-Federated-Learning-for-Unlabeled-Clients-with-Alternate-Training
[NeurIPS 2022] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training
deep-learning distributed-machine-learning federated-learning semi-supervised-learning
Language:Python 27
TinfoilHat0 / Defending-Against-Backdoors-with-Robust-Learning-Rate
The code of AAAI-21 paper titled "Defending against Backdoors in Federated Learning with Robust Learning Rate".
deep-learning backdoor-attacks robust-machine-learning federated-learning distributed-machine-learning pytorch adversarial-attacks machine-learning
Language:Python 27
hwang595 / ATOMO
Atomo: Communication-efficient Learning via Atomic Sparsification
distributed-machine-learning compression communication-efficient
Language:Python 25
orion-orion / Distributed-ML-PySpark
🔨 使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程
distributed-computing distributed-machine-learning machine-learning spark
Language:Python 24
ishugaepov / MLBD
Materials for "Machine Learning on Big Data" course
big-data machine-learning spark mapreduce distributed-machine-learning large-scale-machine-learning
Language:Jupyter Notebook 21
NErlNet
leondavi / NErlNet
Nerlnet is a distributed machine learning platform for experiments and IoT deployment.
erlang neural-network distributed-machine-learning cpp python cowboy nifpp erl erlang-otp scons nerlnet eigen cmake federated federated-learning iot machine-learning
Language:Python 19
soumyadipghosh / eventgrad
Event-Triggered Communication in Parallel Machine Learning
machine-learning distributed-machine-learning pytorch parallel-machine-learning mpi communication-efficient
Language:C++ 19
beiyuouo / fedhf
🔨 A Flexible Federated Learning Simulator for Heterogeneous and Asynchronous.
fedhf federated-learning federated-learning-framework python distributed-machine-learning machine-learning
Language:Python 18
Collaborative-AI / colda
Collaborative Data Analysis for All
assisted-learning collaborative-machine-learning distributed-machine-learning data-analysis deep-learning
Language:Jupyter Notebook 18
Byzantine-resilient-distributed-learning
INSPIRE-Lab-US / Byzantine-resilient-distributed-learning
Associated codebase for Byzantine-resilient distributed / decentralized machine learning papers from INSPIRE Lab
machine-learning byzantine-failures distributed-machine-learning gradient-descent coordinate-descent
Language:Python 12
Fangjin98 / distributed-training-INA
A PS ML training architecture with p4 programmable switches.
in-network-compute pytorch distributed-machine-learning
Language:Python 10
MultiHop-Federeated-Split-Learning
jtirana98 / MultiHop-Federeated-Split-Learning
Framework that supports pipeline federated split learning with multiple hops.
distributed-machine-learning federated-learning libtorch split-learning
Language:C++ 10
ray-project / ray-acm-workshop-2023
Scalable/Distributed Computer Vision with Ray
ai computer-vision machine-learning parallel-computing ray-distributed distributed-machine-learning ray-air pytorch scalable-machine-learning
Language:Jupyter Notebook 9
benedekrozemberczki / AV_Ultimate_Student_Hunt
Solution for the Ultimate Student Hunt Challenge (1st place).
winning-entry machine-learning r analytics-vidhya-competition kaggle driven-data competition xgboost gradient-boosting extreme-gradient-boosting supervised-learning distributed-machine-learning data-cleaning forecasting weather-forecast data-engineering data-engineering-pipeline student-hunt
Language:R 8
snuspl / harmony
Harmony: A new scheduling framework that executes multiple Parameter-Server (PS) Machine Learning (ML) training jobs efficiently to improve cluster resource utilization.
distributed-machine-learning resource-scheduling
Language:Java 8
zxsimple / dmls
Distributed Machine Learning Studio
distributed-machine-learning machine-learning machine-learning-platform drag-and-drop
Language:Scala 8
benedekrozemberczki / NestedSubtreeHash
A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).
graph-kernel streaming-data streaming-processing distributed-machine-learning large-scale-learning hashing machine-learning representation-learning graph-mining feature-extraction multi-scale deepwalk word2vec graph-classification data-mining data-science node2vec gensim
Language:Python 7
borgwang / distributed-ml
Distributed Neural Networks Training
distributed-computing distributed-machine-learning
Language:Python 5
diaoenmao / GAL-Gradient-Assisted-Learning-for-Decentralized-Multi-Organization-Collaborations
[NeurIPS 2022] GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborations
deep-learning distributed-machine-learning assisted-learning
Language:Python 5
ray-project / anyscale-workshop-nyc-2023
Scalable NLP model fine-tuning and batch inference with Ray and Anyscale
anyscale distributed-deep-learning distributed-machine-learning nlp ray mlops
Language:Jupyter Notebook 5
aliciatang07 / Spark-Ring-AllReduce
Ring Allreduce implmentation in Spark with Barrier Scheduling experiment
spark distributed-machine-learning
Language:Scala 4
diaoenmao / DRASIC-Distributed-Recurrent-Autoencoder-for-Scalable-Image-Compression
[DCC 2020] DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression
data-compression distributed-machine-learning
Language:Python 4
ray-project / ray-saturday-dec-2022
Ray Saturday Dec 2022 edition
batch-inference computer-vision distributed-machine-learning ray-distributed semantic-segmentation ray-air ray-core
Language:Jupyter Notebook 4

distributed-machine-learning

terrytangyuan / distributed-ml-patterns

ray-project / ray-educational-materials

diaoenmao / HeteroFL-Computation-and-Communication-Efficient-Federated-Learning-for-Heterogeneous-Clients

INET-RC / GeoMX

anupamkliv / FedERA

PaddlePaddle / PaddleDTX

monk1337 / Aweome-Heathcare-Federated-Learning

GuanhuaWang / sensAI

cleanzr / dblink

orion-orion / FedAO

pooyanjamshidi / mls

xinyandai / gradient-quantization

makgyver / gossipy

diaoenmao / SemiFL-Semi-Supervised-Federated-Learning-for-Unlabeled-Clients-with-Alternate-Training

TinfoilHat0 / Defending-Against-Backdoors-with-Robust-Learning-Rate

hwang595 / ATOMO

orion-orion / Distributed-ML-PySpark

ishugaepov / MLBD

leondavi / NErlNet

soumyadipghosh / eventgrad

beiyuouo / fedhf

Collaborative-AI / colda

INSPIRE-Lab-US / Byzantine-resilient-distributed-learning

Fangjin98 / distributed-training-INA

jtirana98 / MultiHop-Federeated-Split-Learning

ray-project / ray-acm-workshop-2023

benedekrozemberczki / AV_Ultimate_Student_Hunt

snuspl / harmony

zxsimple / dmls

benedekrozemberczki / NestedSubtreeHash

borgwang / distributed-ml

diaoenmao / GAL-Gradient-Assisted-Learning-for-Decentralized-Multi-Organization-Collaborations

ray-project / anyscale-workshop-nyc-2023

aliciatang07 / Spark-Ring-AllReduce

diaoenmao / DRASIC-Distributed-Recurrent-Autoencoder-for-Scalable-Image-Compression

ray-project / ray-saturday-dec-2022