Oldpan

DeployIsAllYouNeed

Pytorch-Learn

Learn pytorch the hard way

common

Common source, scripts and utilities shared across all Triton repositories.

core

cpp_blog

cyberdog_ros2

ROS 2 packages for CyberDog

DietCode

DietCode Code Release

discourse-chatbot

A cloud chatbot adaptor for Discourse, currently supporting OpenAI

gradio-chat

HuggingChat like UI in Gradio

imgui-ws

Dear ImGui over WebSockets

llama.onnx

llama/alpaca onnx models, quantization and testcase

markdown-cv

a simple template to write your CV in a readable markdown file and use CSS to publish/print it.

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

mmdeploy

OpenMMLab Model Deployment Framework

mmengine

OpenMMLab Foundational Library for Training Deep Learning Models

model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

myblog-django

My first time to create a blog using Django(not maintained anymore)

onnxruntime_backend

The Triton backend for the ONNX Runtime.

python_backend

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

pytorch_backend

The Triton backend for the PyTorch TorchScript models.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

stable-fast

An ultra lightweight inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

tensorrt_backend

The Triton backend for TensorRT.

tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

tvm_walk_through

code reading for tvm