multi-gpu

There are 4 repositories under multi-gpu topic.

ConfettiFX / The-Forge
The Forge Cross-Platform Rendering Framework PC Windows, Steamdeck (native), Ray Tracing, macOS / iOS, Android, XBOX, PS4, PS5, Switch, Quest 2
directx12 vulkan vulkan-api macos ios xbox ps4 android metal linux-ubuntu linux ray-tracing shaders visibility-buffer vulkan-sdk directx shader-translator multi-gpu multi-threading ps5
Language:C++ 4433
NVIDIA / OpenSeq2Seq
Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
deep-learning float16 language-model mixed-precision multi-gpu multi-node neural-machine-translation seq2seq sequence-to-sequence speech-recognition speech-synthesis speech-to-text tensorflow text-to-speech
Language:Python 1535
rbbrdckybk / dream-factory
Multi-threaded GUI manager for mass creation of AI-generated art with support for multiple GPUs.
ai ai-art generative-art image-generation machine-learning multi-gpu multithreaded nvidia-gpu stable-diffusion
Language:Python 469
v-iashin / video_features
Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, ResNet features.
pytorch multi-gpu feature-extraction parallel video-features visual-features audio-features i3d vggish r2plus1d resnet raft optical-flow ig65m clip s3d laion swin timm vit
Language:Python 434
seasonSH / DocFace
Face recognition system for ID photos
biometrics face-recognition face-verification multi-gpu tensorflow
Language:Python 364
NickLucche / stable-diffusion-nvidia-docker
GPU-ready Dockerfile to run Stability.AI stable-diffusion model v2 with a simple web interface. Includes multi-GPUs support.
docker image-generation nvidia-docker stable-diffusion multi-gpu
Language:Python 346
ParallelStencil.jl
omlins / ParallelStencil.jl
Package for writing high-level code for parallel high-performance stencil computations that can be deployed on both GPUs and CPUs
cuda gpu julia multi-gpu multi-xpu parallel staggered-grids stencil-codes xpu
Language:Julia 286
lattice / quda
QUDA is a library for performing calculations in lattice QCD on GPUs.
c c-plus-plus cuda gpu mpi multi-gpu qcd
Language:C++ 270
tamerthamoqa / facenet-pytorch-glint360k
A PyTorch implementation of the 'FaceNet' paper for training a facial recognition model with Triplet Loss using the glint360k dataset. A pre-trained model using Triplet Loss is available for download.
face-recognition facenet triplet-loss lfw-dataset vggface2-dataset pytorch pretrained-model multi-gpu
Language:Python 217
bharatsingh430 / py-R-FCN-multiGPU
Code for training py-faster-rcnn and py-R-FCN on multiple GPUs in caffe
faster-rcnn multi-gpu object-detection
Language:Jupyter Notebook 193
heat
helmholtz-analytics / heat
Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python
gpu tensors distributed machine-learning mpi numpy python pytorch array-api data-analytics data-processing data-science hpc massive-datasets mpi4py multi-gpu multi-node-cluster parallelism
Language:Python 192
guotong1988 / BERT-GPU
multi-gpu pre-training in one machine for BERT from scratch without horovod (Data Parallelism)
bert multi-gpu nlp tensorflow
Language:Python 171
papuSpartan / stable-diffusion-webui-distributed
Chains stable-diffusion-webui instances together to facilitate faster image generation.
stable-diffusion stable-diffusion-webui stable-diffusion-webui-plugin automatic1111 distributed-computing multi-gpu
Language:Python 159
GPUSPH / gpusph
The world's first CUDA implementation of Weakly-Compressible Smoothed Particle Hydrodynamics
cuda gpu multi-gpu sph fsi hpc multi-platform
Language:C++ 154
ImplicitGlobalGrid.jl
eth-cscs / ImplicitGlobalGrid.jl
Almost trivial distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid
cuda distributed gpu julia julia-mpi-wrapper mpi multi-gpu staggered-grids stencil-codes
Language:Julia 152
FZJ-JSC / tutorial-multi-gpu
Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial
hpc mpi exascale-computing gpu multi-gpu sc21 supercomputing nccl nvshmem cuda isc22 sc22 sc23 isc23
Language:Cuda 133
tensordiffeq / TensorDiffEq
Efficient and Scalable Physics-Informed Deep Learning and Scientific Machine Learning on top of Tensorflow for multi-worker distributed computing
pinns scientific-machine-learning tensorflow tensorflow2 physics-informed-learning physics-informed-neural-networks gpu gpu-computing gpu-acceleration multi-gpu multi-gpu-training neural-networks differential-equations neural-pde collocation distributed-systems
Language:Python 104
tugrul512bit / Cekirdekler
Multi-device OpenCL kernel load balancer and pipeliner API for C#. Uses shared-distributed memory model to keep GPUs updated fast while using same kernel on all devices(for simplicity).
opencl-kernels iterative load-balancer pipelining multi-device gpgpu multi-gpu zero-copy gpu-computing gpu-acceleration multi gpu pool batch-processing dynamic parallelism opencl
Language:C# 93
hfxunlp / transformer
Neutron: A pytorch based implementation of Transformer and its variants.
neural-machine-translation transformer seq2seq natural-language-processing attention-is-all-you-need average-attention-network dynamic-sentence-sampling robust-neural-machine-translation beam-search ensemble average-models pytorch python3 multi-gpu sentential-context context-aware-nmt relative-position optimizers dynamic-batch-size multilingual-nmt
Language:Python 63
projectchrono / DEM-Engine
A dual-GPU DEM solver with complex grain geometry support
chrono cuda discrete-element-method multi-gpu gpu simulation
Language:C++ 50
rickiepark / deep-learning-with-python-2nd
<케라스 창시자에게 배우는 딥러닝 2판> 도서의 코드 저장소
cnn deep-learning gan image-classification image-style-transfer keras neural-network rnn tensorflow text-classification text-generation transformer image-augmentation image-segmentation keras-tuner machine-translation mixed-precision multi-gpu tpu time-series
Language:Jupyter Notebook 49
andreped / GradientAccumulator
:dart: Accumulated Gradients for TensorFlow 2
tensorflow accumulated-gradients tensorflow2 tf2 batch-size memory-constraints gradient-accumulation distributed-training float16 mixed-precision deep-learning keras adaptive-gradient-clipping gpu tpu huggingface accumulated-batch-normalization multi-gpu hacktoberfest
Language:Python 47
kuixu / keras_multi_gpu
Multi-GPU training for Keras
multi-gpu keras data-parallelism
Language:Python 44
lupantech / dual-mfa-vqa
Co-attending Regions and Detections for VQA.
aaai attention-mechanism caffe faster-rcnn multi-gpu multi-modal object-detection torch visual-question-answering vqa
Language:Matlab 40
predsci / POT3D
POT3D: High Performance Potential Field Solver
gpu openacc potential-fields stdpar cuda-aware-mpi do-concurrent multi-gpu
Language:Fortran 39
gpuvmem
miguelcarcamov / gpuvmem
GPU Framework for Radio Astronomical Image Synthesis
gpu-computing gpu-acceleration multi-gpu alma ska vla astronomical-images astrophysics optimization-methods complex-systems radioastronomy maximum-entropy astronomical-algorithms image-synthesis cuda radio-imaging radio-interferometry gpu
Language:Cuda 28
YukeWang96 / MGG_OSDI23
Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Multi-GPU Platforms.
deeplearning gnn gpu graph graphneuralnetwork multi-gpu nvshmem
Language:Cuda 28
kentaroy47 / pytorch-mgpu-cifar10
testing multi gpu for pytorch
pytorch gpu multi-gpu cifar10 dnn
Language:Python 24
dmarnerides / dlt
Deep Learning Toolbox for Torch
torch multi-gpu toolbox hpc-facilities slurm-job deep-neural-networks
Language:Lua 21
Erfan-Ahmadi / TheForgeExamples
Graphic Techniques Implemented on The Forge API, a cross-platform rendering framework on top of Vulkan, DirectX, Metal
ambient-occlusion blinn-phong deffered directx directx12 direcx-12 glsl graphics-programming hlsl learning lighting multi-gpu multi-threading shaders the-forge toon toonshading vulkan vulkan-api
Language:C++ 20
ParCoreLab / CPU-Free-model
Source code for the CPU-Free model - a fully autonomous execution model for multi-GPU applications that completely excludes the involvement of the CPU beyond the initial kernel launch.
conjugate-gradient cuda gpu-initiated-communication high-performance iterative-solvers jacobi jacobi-iteration multi-gpu nsvhmem nvshmem persistent-kernels stencil
Language:Cuda 14
Zhengyu-Li / Deep-Network-Compression-based-on-Student-Teacher-Network-
Deep Neural Network Compression based on Student-Teacher Network
network-compression deeplearning densenet teacher-student multi-gpu tensorflow
Language:Python 14
farkhor / WS-VR
A CUDA-based multi-GPU vertex-centric graph processing framework based on Warp Segmentation and Vertex Refinement techniques.
graph-processing cuda warp-segmentation vertex-refinement gpu multi-gpu csr
Language:Cuda 10
18520339 / ml-distributed-training
Distributed training with Multi-worker & Parameter Server in TensorFlow 2
distributed distributed-tensorflow distributed-training multi-gpu multi-workers parameter-server tensorflow
Language:Jupyter Notebook 9
diver-j / melgan-multi
MelGAN Multi GPU Implementation.
melgan multi-gpu distributed vocoder tts speech-synthesis audio
Language:Python 8
previsionio / damavand
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
quantum-computing rust cuda hpc distributed-computing multi-gpu multithreading simulator
Language:Rust 8

multi-gpu

ConfettiFX / The-Forge

NVIDIA / OpenSeq2Seq

rbbrdckybk / dream-factory

v-iashin / video_features

seasonSH / DocFace

NickLucche / stable-diffusion-nvidia-docker

omlins / ParallelStencil.jl

lattice / quda

tamerthamoqa / facenet-pytorch-glint360k

bharatsingh430 / py-R-FCN-multiGPU

helmholtz-analytics / heat

guotong1988 / BERT-GPU

papuSpartan / stable-diffusion-webui-distributed

GPUSPH / gpusph

eth-cscs / ImplicitGlobalGrid.jl

FZJ-JSC / tutorial-multi-gpu

tensordiffeq / TensorDiffEq

tugrul512bit / Cekirdekler

hfxunlp / transformer

projectchrono / DEM-Engine

rickiepark / deep-learning-with-python-2nd

andreped / GradientAccumulator

kuixu / keras_multi_gpu

lupantech / dual-mfa-vqa

predsci / POT3D

miguelcarcamov / gpuvmem

YukeWang96 / MGG_OSDI23

kentaroy47 / pytorch-mgpu-cifar10

dmarnerides / dlt

Erfan-Ahmadi / TheForgeExamples

ParCoreLab / CPU-Free-model

Zhengyu-Li / Deep-Network-Compression-based-on-Student-Teacher-Network-

farkhor / WS-VR

18520339 / ml-distributed-training

diver-j / melgan-multi

previsionio / damavand