cuda-kernels

There are 16 repositories under cuda-kernels topic.

NVIDIA / cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
cuda cuda-driver-api cuda-kernels cuda-opengl
Language:C 6467
InternLM / lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind
Language:Python 4688
coreylowman / dfdx
Deep learning in Rust, with shape checked tensors and neural networks
autodiff autodifferentiation autograd backpropagation cuda cuda-kernels cuda-support cuda-toolkit cudnn deep-learning deep-neural-networks gpu gpu-acceleration gpu-computing machine-learning neural-network rust rust-lang tensor
Language:Rust 1740
NVIDIA / cccl
CUDA Core Compute Libraries
accelerated-computing cpp cpp-programming cuda cuda-cpp cuda-kernels cuda-library cuda-programming gpu gpu-acceleration gpu-computing gpu-programming hpc nvidia nvidia-gpu parallel-algorithm parallel-computing parallel-programming modern-cpp
Language:C++ 1286
coreylowman / cudarc
Safe rust wrapper around CUDA toolkit
cuda cuda-programming cuda-toolkit gpu gpu-acceleration rust cublas curand cuda-kernels nvrtc cudnn nccl
Language:Rust 632
TensorRT-YOLO
laugh12321 / TensorRT-YOLO
🚀 你的YOLO部署神器。TensorRT Plugin、CUDA Kernel、CUDA Graphs三管齐下，享受闪电般的推理速度。| Your YOLO Deployment Powerhouse. With the synergy of TensorRT Plugins, CUDA Kernels, and CUDA Graphs, experience lightning-fast inference speeds.
detection onnx ppyoloe tensorrt yolov5 yolov8 cuda yolov9 yolov6 yolov7 yolov3 cuda-graph cuda-kernels cuda-programming ultralytics obb-yolo
Language:C++ 629
NVIDIA / nvbench
CUDA Kernel Benchmarking Library
benchmark cuda cuda-kernels gpu kernel-benchmark nvidia performance
Language:Cuda 519
harrism / hemi
Simple utilities to enable code reuse and portability between CUDA C/C++ and standard C/C++.
c-plus-plus cuda cuda-device cuda-kernels gpu hemi
Language:C++ 343
kernel_tuner
KernelTuner / kernel_tuner
Kernel Tuner
auto-tuning autotuning c cplusplus cuda cuda-kernels gpu gpu-computing kernel-tuner machine-learning opencl opencl-kernels optimization python software-development testing
Language:Python 287
jaredhoberock / stanford-cs193g-sp2010
This is an archive of materials produced for an introductory class on CUDA programming at Stanford University in 2010
cuda cuda-kernels cuda-programming gpu-programming
Language:C++ 203
deepakkumar1984 / Amplifier.NET
Amplifier allows .NET developers to easily run complex applications with intensive mathematical computation on Intel CPU/GPU, NVIDIA, AMD without writing any additional C kernel code. Write your function in .NET and Amplifier will take care of running it on your favorite hardware.
opencl cuda-kernels opencl-kernels compiler gpgpu gpgpu-computing gpgpu-sim simd
Language:C# 175
HMUNACHI / cuda-repo
From zero to hero CUDA for accelerating maths and machine learning on GPU.
cuda cuda-kernels cuda-programming machine-learning maths
Language:Cuda 171
PatWie / cuda-design-patterns
Some CUDA design patterns and a bit of template magic for CUDA
bazel cpp11 cuda cuda-development cuda-device cuda-kernels cuda-utils gpu template-metaprogramming
Language:C++ 146
tudelft / cuSNN
Spiking Neural Networks in C++ with strong GPU acceleration through CUDA
cuda cuda-kernels neural-network spiking-neural-networks
Language:Cuda 121
eyalroz / cuda-kat
CUDA kernel author's tools
cuda cuda-kernels utility-library utility-functions cpp11 constexpr algorithms patterns modern-cpp gpu-programming gpu elegant-coding cuda-library cuda-programming printf printf-functions
Language:Cuda 109
Accera
microsoft / Accera
Open source cross-platform compiler for compute-intensive loops used in AI algorithms, from Microsoft Research
cross-platform loop-fusion loop-unrolling python-library optimization-framework research machine-learning-algorithms gpu-acceleration cpu-scheduling tuning-parameters cross-compiler loop-scheduling compiler rocm-kernel cuda-kernels
Language:C++ 103
wangsiping97 / FastGEMV
High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
cuda cuda-kernels machine-learning optimization
Language:Cuda 87
alexzhang13 / flashattention2-custom-mask
Triton implementation of FlashAttention2 that adds Custom Masks.
attention attention-mechanism cuda-kernels deep-learning flash-attention flash-attention-2 triton triton-lang
Language:Python 78
yalue / cuda_scheduling_examiner_mirror
A tool for examining GPU scheduling behavior.
benchmark cuda cuda-kernels gpu gpu-scheduling mandelbrot
Language:Cuda 69
bgin / Radar-ElectroOptical-Simulation
(REOS) Radar and Electro-Optical Simulation Framework written in C++.
simd-instructions avx512 avx2 avx vectorization high-performance-computing control-theory gpu-acceleration cuda-kernels amd-gpu modelling fortran90 radar atmosphere-model simulation infrared-sensors radiative-transfer radar-signal-processing
Language:C++ 58
CUDA-Guide
mikeroyal / CUDA-Guide
CUDA Guide
cuda gpu deep-learning machine-learning cuda-toolkit cuda-programming awesome awesome-list awesome-readme cuda-kernels cuda-library cuda-opengl cuda-support gpgpu-computing graphics-programming cuda-development cuda-driver gpgpu resources
Language:Cuda 58
emptysoal / cuda-image-preprocess
Speed up image preprocess with cuda when handle image or tensorrt inference
cnn cuda-programming deep-learning image-processing tensorrt cuda cuda-demo cuda-kernels
Language:Cuda 54
bgin / Radar_ElectroOptical_Simulation
(REOS) Radar and ElectroOptical Simulation Framework written in Fortran.
radar simulation avx-512 avx2 avx simd openmp high-performance-computing control-systems modeling vectorization cuda-kernels gpu-acceleration amdgpu fortran90 c99 infrared-sensors radiative-transfer
Language:Fortran 48
STEllAR-GROUP / octotiger
Astrophysics program simulating the evolution of star systems based on the fast multipole method on adaptive Octrees
astrophysics hpx cuda-kernels cuda stellar-mergers kokkos simd sycl
Language:C++ 48
p-sto / ConjugateGradients
Implementation of ConjugateGradients method using C and Nvidia CUDA
conjugate-gradient nvidia-cuda numerical-methods gpgpu cuda-kernels numpy linear-equations mkl-pardiso c
Language:Python 47
evlasblom / cuda-opencv-examples
Using custom CUDA kernels with Open CV Mat objects.
cuda cuda-kernels opencv
Language:Cuda 36
HuangCongQing / cuda-learning
cuda编程学习入门
cuda cuda-kernels cuda-programming
Language:Cuda 31
conradsnicta / bandicoot-code
Bandicoot: C++ library for GPU linear algebra & scientific computing - https://coot.sourceforge.io
c-plus-plus opencl gpu opencl-kernels matrix-functions matrix-library armadillo linear-algebra linear-algebra-library scientific-computing machine-learning clblas cublas cuda cuda-kernels cusolver gpu-accelerated-library gpu-acceleration gpu-computing
27
CUDA-PCA-jacobi
arneish / CUDA-PCA-jacobi
CUDA C implementation of Principal Component Analysis (PCA) through Singular Value Decomposition (SVD) using a highly parallelisable version of the Jacobi eigenvalue algorithm.
cuda cuda-kernels pca-analysis principal-component-analysis svd gpu parallel-programming c jacobi-eigenvalues hpc gpu-computing
Language:Cuda 26
rnowotniak / qopt
Quantum-inspired evolutionary algorithms for Optimization problems
algorithms c cpp cuda cuda-kernels cython evolutionary-algorithms genetic-algorithm numerical-optimization optimization-algorithms python quantum-computing quantum-inspired-genetic-algorithm
Language:C++ 25
henryfriedlander / CUDA-LBM-simulator
This is a Lattice-Boltzmann simulation using CUDA GPU graphics optimization.
cuda cuda-kernels opengl visual-studio lattice-boltzmann computational-fluid-dynamics
Language:Cuda 24
yoyoberenguer / PygameShader
2D Game texture special effects
pygame shaders special-effects effects 2d 2d-graphics image-processing cuda cuda-kernels cupy gpu graphics openmp game game-2d game-development game-library indiegame
Language:Cython 24
aredden / torch-bnb-fp4
Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
cuda-kernels python pytorch pytorch-extension quantization
Language:Python 23
StiffMa
fjramireg / StiffMa
StiffMa: Fast finite element STIFFness MAtrix generation in MATLAB by using GPU computing.
matlab gpu-computing gpu-acceleration finite-element-methods finite-element-analysis stiffness pde-solver nvidia-cuda cuda-kernels cuda-programming parallel-computing parallel-computing-toolbox
Language:MATLAB 23
ThoenigAdrian / NeuralNetworksCudaTutorial
Implement Neural Networks in Cuda from Scratch
cuda cuda-kernels machine-learning neural-networks tutorial
Language:C++ 22
Koushikphy / Intro-to-CUDA-Fortran
A Complete beginner's introduction to programming with CUDA Fortran
cuda cuda-kernels cuda-programming fortran fortran90 cuda-fortran gpgpu gpu gpu-computing high-performance-computing hpc nvidia nvidia-cuda parallel-computing parallel-programming
21

cuda-kernels

NVIDIA / cuda-samples

InternLM / lmdeploy

coreylowman / dfdx

NVIDIA / cccl

coreylowman / cudarc

laugh12321 / TensorRT-YOLO

NVIDIA / nvbench

harrism / hemi

KernelTuner / kernel_tuner

jaredhoberock / stanford-cs193g-sp2010

deepakkumar1984 / Amplifier.NET

HMUNACHI / cuda-repo

PatWie / cuda-design-patterns

tudelft / cuSNN

eyalroz / cuda-kat

microsoft / Accera

wangsiping97 / FastGEMV

alexzhang13 / flashattention2-custom-mask

yalue / cuda_scheduling_examiner_mirror

bgin / Radar-ElectroOptical-Simulation

mikeroyal / CUDA-Guide

emptysoal / cuda-image-preprocess

bgin / Radar_ElectroOptical_Simulation

STEllAR-GROUP / octotiger

p-sto / ConjugateGradients

evlasblom / cuda-opencv-examples

HuangCongQing / cuda-learning

conradsnicta / bandicoot-code

arneish / CUDA-PCA-jacobi

rnowotniak / qopt

henryfriedlander / CUDA-LBM-simulator

yoyoberenguer / PygameShader

aredden / torch-bnb-fp4

fjramireg / StiffMa

ThoenigAdrian / NeuralNetworksCudaTutorial

Koushikphy / Intro-to-CUDA-Fortran