cuda

There are 215 repositories under cuda topic.

vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt llm pytorch llmops mlops model-serving transformer llm-serving inference llama amd rocm cuda inferentia trainium tpu xpu
Language:Python 27004
hashcat / hashcat
World's fastest and most advanced password recovery utility
c cracking cuda gpgpu hashcat hashes opencl password
Language:C 20915
NVIDIA / nvidia-docker
Build and run Docker containers leveraging NVIDIA GPUs
nvidia-docker docker cuda gpu
17193
instant-ngp
NVlabs / instant-ngp
Instant neural graphics primitives: lightning fast NeRF and more
3d-reconstruction computer-graphics computer-vision cuda function-approximation machine-learning nerf neural-network real-time real-time-rendering realtime signed-distance-functions
Language:Cuda 15827
kaldi-asr / kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.
c-plus-plus cuda kaldi shell speaker-id speaker-verification speech speech-recognition speech-to-text
Language:Shell 14134
Open3D
isl-org / Open3D
Open3D: A Modern Library for 3D Data Processing
mesh-processing computer-graphics opengl cpp python reconstruction odometry visualization registration machine-learning 3d pointcloud rendering gui 3d-perception gpu arm cuda pytorch tensorflow
Language:C++ 11229
numba
numba / numba
NumPy aware dynamic Python compiler using LLVM
compiler cuda llvm numba numpy parallel python
Language:Python 9795
vosen / ZLUDA
CUDA on ??? GPUs
cuda rust
Language:Rust 8946
rapidsai / cudf
cuDF - GPU DataFrame Library
arrow cpp cuda cudf dask data-analysis data-science dataframe gpu pandas pydata python rapids
Language:C++ 8267
cupy / cupy
NumPy & SciPy for GPU
cublas cuda cudnn cupy curand cusolver cusparse cusparselt cutensor gpu nccl numpy nvrtc nvtx python rocm scipy tensor
Language:Python 8266
catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
big-data catboost categorical-features coreml cuda data-mining data-science decision-trees gbdt gbm gpu gpu-computing gradient-boosting kaggle machine-learning python r tutorial
Language:Python 8001
replicate / cog
Containers for machine learning
ai containers cuda deep-learning docker machine-learning pytorch tensorflow
Language:Python 7814
kroma-network / tachyon
Modular ZK(Zero Knowledge) backend accelerated by GPU
blockchain c-plus-plus cpp17 cryptocurrency cryptography cuda kroma tachyon zero-knowledge zk
Language:C++ 7778
hybridgroup / gocv
Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, and OpenCV Contrib.
caffe computer-vision computervision cuda dnn face-tracking gocv golang image-processing mjpeg mjpeg-stream object-classification object-tracking opencv openvino tensorflow torch video video-capture
Language:Go 6591
NVIDIA / cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
cuda cuda-driver-api cuda-kernels cuda-opengl
Language:C 6103
chainer / chainer
A flexible framework of neural networks for deep learning
chainer cuda cudnn cupy deep-learning gpu machine-learning neural-network neural-networks numpy python
Language:Python 5885
oneflow
Oneflow-Inc / oneflow
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
deep-learning machine-learning deep-neural-networks ml distributed neural-network cuda
Language:C++ 5865
srush / GPU-Puzzles
Solve puzzles. Learn CUDA.
cuda machine-learning puzzles
Language:Jupyter Notebook 5734
NVIDIA / cutlass
CUDA Templates for Linear Algebra Subroutines
cpp cuda deep-learning deep-learning-library gpu nvidia
Language:C++ 5375
sgl-project / sglang
SGLang is a fast serving framework for large language models and vision language models.
cuda inference llama llama2 llama3 llama3-1 llava llm llm-serving moe pytorch transformer vlm
Language:Python 5168
thrust
NVIDIA / thrust
[ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl
cuda nvidia-hpc-sdk thrust gpu cpp cpp11 cpp14 cpp17 cpp20 cxx cxx11 cxx14 cxx17 cxx20 algorithms nvidia gpu-computing
Language:C++ 4909
nvitop
XuehaiPan / nvitop
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
command-line-tool console cuda curses gpu gpu-monitoring grafana grafana-dashboard htop monitoring monitoring-tool nvidia nvidia-smi nvml process-monitoring prometheus prometheus-exporter resource-monitor top
Language:Python 4628
OAID / Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
arm machine-learning artificial-intelligence cnn tensorflow pytorch onnx x86-64 mips cuda tensorrt acl npu riscv supperedge container nvdla
Language:C++ 4618
arrayfire
arrayfire / arrayfire
ArrayFire: a general purpose GPU library.
arrayfire c c-plus-plus cpp cuda gpgpu gpu hpc opencl performance scientific-computing
Language:C++ 4525
alien
chrxh / alien
ALIEN is a CUDA-powered artificial life simulation program.
agent-based-simulation artificial-life cuda open-ended-evolution physics-engine
Language:C++ 4467
NVIDIAGameWorks / kaolin
A PyTorch Library for Accelerating 3D Deep Learning Research
pytorch 3d-deep-learning neural-networks differentiable-rendering artificial-intelligence camera-api cuda rasterization differentiable-lighting
Language:Python 4428
rapidsai / cuml
cuML - RAPIDS Machine Learning Library
machine-learning-algorithms machine-learning cuda gpu nvidia
Language:C++ 4159
ROCm / HIP
HIP: C++ Heterogeneous-Compute Interface for Portability
cuda hip hip-kernel-language hip-portability hip-runtime hipify
Language:C++ 3695
NVlabs / tiny-cuda-nn
Lightning fast C++/CUDA neural network framework
neural-network deep-learning gpu cuda mlp nerf rendering real-time pytorch
Language:C++ 3670
OpenNMT / CTranslate2
Fast inference engine for Transformer models
neural-machine-translation cpp mkl quantization cuda thrust opennmt deep-neural-networks openmp onednn intrinsics avx2 avx parallel-computing gemm neon transformer-models machine-translation deep-learning inference
Language:C++ 3231
bytedance / lightseq
LightSeq: A High Performance Library for Sequence Processing and Generation
inference transformer beam-search bert cuda sampling diverse-decoding multilingual-nmt training bart gpt accelerate
Language:C++ 3171
Celtoys / Remotery
Single C file, Realtime CPU/GPU Profiler with Remote Web Viewer
c cpu cuda d3d11 d3d12 gpu metal opengl profiler vulkan
Language:C 3101
Jittor / jittor
Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
cuda deep-learning gpu jittor python
Language:Python 3071
uber / aresdb
A GPU-powered real-time analytics storage and query engine.
analytics cgo cuda data database golang gpu-programming query real-time storage
Language:Go 3021
heavyai / heavydb
HeavyDB (formerly OmniSciDB)
cuda database gpu heavyai interactive llvm machine-learning mapd olap omnisci real-time sql visualization
Language:C++ 2937
iree-org / iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
compiler cuda jax machine-learning mlir pytorch runtime spirv tensorflow vulkan
Language:C++ 2564

Related Topics