Awesome GPU Notes
GPU and CUDA Documents
GPU architecture
CUDA
-
CUDA Sample Code
Topics
- https://developer.nvidia.com/blog/inside-volta/
- https://developer.nvidia.com/blog/cuda-pro-tip-optimized-filtering-warp-aggregated-atomics/
- https://developer.nvidia.com/blog/cooperative-groups/
Inference
TensorRT
Triton
Training
Tools
NVIDIA System Management (nvidia-smi and NVML)
TBA
NVIDIA Nsight Systems
Videos:
-
University of Illinois ECE 408 - Nsight Compute and Nsight Systems:
Modulus, AI for science
- Deep Learning for Science and Engineering, George Karniadakis, Professor, Brown University
- DLI
- End-to-End AI for Science