dusty-nv

jetson-inference

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

ros_deep_learning

Deep learning inference nodes for ROS / ROS2 with support for NVIDIA Jetson and TensorRT

jetson-utils

C++/CUDA/Python multimedia utilities for NVIDIA Jetson

jetson-voice

ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT

NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

jetson-presentations

PDF slides about NVIDIA's Jetson embedded platform and deep learning.

pytorch-ssd

MobileNetV1, MobileNetV2, VGG based SSD/SSD-lite implementation in PyTorch. Out-of-box support for retraining on Open Images dataset. ONNX and Caffe2 support. Experiment Ideas like CoordConv.

camera-capture

GUI tool for collecting & labeling data from live camera feed

pytorch-classification

Training of image classification models with PyTorch

pytorch-detection

Training of object detection networks with PyTorch

NanoDB

Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP

clip_trt

CLIP and SigLIP models optimized with TensorRT with a Transformers-like API

gtc-llm-lab

Jetson AI Lab - LLM Inference

pytorch-timeseries

bitsandbytes

8-bit CUDA functions for PyTorch, modified to build on NVIDIA Jetson

jetson-generative-ai-playground

small-stable-diffusion

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

llama-cpp-python

Python bindings for llama.cpp

llama.cpp

Port of Facebook's LLaMA model in C/C++

robosuite

robosuite: A Modular Simulation Framework and Benchmark for Robot Learning

whisper_trt

A project that optimizes Whisper for low latency inference using NVIDIA TensorRT

cuml

cuML - RAPIDS Machine Learning Library

mimicgen

This code corresponds to simulation environments used as part of the MimicGen project.

openvla

OpenVLA: An open-source vision-language-action model for robotic manipulation.

stable-diffusion-webui-tensorrt

cudf

cuDF - GPU DataFrame Library

dash-draggable

Dash components for building draggable and resizable grid layouts. Based on the well-known STRML/react-grid-layout.

llm-awq

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration