nccl
There are 0 repository under nccl topic.
- Language:Python 10498
coreylowman / cudarc
Safe rust wrapper around CUDA toolkit
Language:Rust 926huggingface / llm_training_handbook
An open collection of methodologies to help with successful training of large language models.
Language:Python 511An open collection of implementation tips, tricks and resources for training large language models
Language:Python 479LambdaLabsML / distributed-training-guide
Best practices & guides on how to write distributed pytorch training code
Language:Python 478FZJ-JSC / tutorial-multi-gpu
Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial
Language:Cuda 298Bluefog-Lib / bluefog
Distributed and decentralized training framework for PyTorch over graph
Language:Python 253- Language:Python 191
google / nccl-fastsocket
NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
Language:C++ 121muriloboratto / NCCL
Sample examples of how to call collective operation functions on multi-GPU environments. A simple example of using broadcast, reduce, allGather, reduceScatter and sendRecv operations.
- Language:Julia 28
- Language:Python 24
openhackathons-org / nways_multi_gpu
N-Ways to Multi-GPU Programming
Language:C 211duo / nccl-examples
NCCL Examples from Official NVIDIA NCCL Developer Guide.
Language:CMake 18- Language:Rust 15
YinLiu-91 / ncclOperationPlus
use ncclSend ncclRecv realize ncclSendrecv ncclGather ncclScatter ncclAlltoall
Language:Cuda 8UCBerkeley-Spring2022-CS267-project / blinkplus
Blink+: Increase GPU group bandwidth by utilizing across tenant NVLink.
Language:Jupyter Notebook 6asprenger / distributed-training-patterns
Experiments with low level communication patterns that are useful for distributed training.
Language:Python 5- Language:Python 5
rohwid / auto-nvidia-cuda-driver
Installation script to install Nvidia driver and CUDA automatically in Ubuntu
Language:Shell 5YconquestY / nccl
Summary of call graphs and data structures of NVIDIA Collective Communication Library (NCCL)
Language:D2 5lcskrishna / nccl-rccl-parser
Tool to run rccl-tests/nccl-tests based on from an application and gather performance.
Language:Python 3- Language:Go 2
lancelee82 / necklace
Distributed deep learning framework based on pytorch/numba/nccl and zeromq.
Language:Python 2MurrellGroup / Conflux.jl
Single-node data parallelism in Julia with CUDA
Language:Julia 2rodhuega / tfgMatrixNccl
Librería de operaciones matemáticas con matrices multi-gpu utilizando Nvidia NCCL.
Language:Cuda 2superlinear-ai / scipy-notebook-gpu
jupyter/scipy-notebook with CUDA Toolkit, cuDNN, NCCL, and TensorRT
Language:Dockerfile 2nikombr / hpccuda
Advanced High Performance Computing in C with OpenMP, CUDA, MPI and NCCL. The folder project includes my final project for the special course. I implemented a Jacobi-solver for the Poisson partial differential problem both using OpenMP in the CPU, using CUDA on the GPU and using CUDA, MPI and NCCL on multiple GPUs.
Language:C++ 1- Language:Cuda 1
GPU-Blood-Cell-Simulation / Simulation-Server
Blood Cell Simulation server
Language:C++ 0melanie-t27 / 2024-EUMaster4HPC-Student-Challenge
EUMaster4HPC student challenge group 7 - EuroHPC Summit 2024 Antwerp
Language:Cuda 0SquareFactory / ml-default
Default Docker image used to run experiments on csquare.run.
Language:Dockerfile 0TyBruceChen / Tutorial-Conda-cuDNN-NCCL-installation-for-Pytorch
This is a tutorial for installing CUDA (v11.8) and cuDNN (8.6.9) to enable programming torch with GPU. It also mentions about implementation of NCCL for distributed GPU DNN model training.
Language:Jupyter Notebook
