Oldpan

Pytorch-Memory-Utils

pytorch memory track code

DeployIsAllYouNeed

Pytorch-Learn

Learn pytorch the hard way

CodeTeasure

分享一些对你有价值的东西(详细请看简介)

common

Common source, scripts and utilities shared across all Triton repositories.

core

cpp_blog

cyberdog_ros2

ROS 2 packages for CyberDog

DietCode

DietCode Code Release

discourse-chatbot

A cloud chatbot adaptor for Discourse, currently supporting OpenAI

gradio-chat

HuggingChat like UI in Gradio

imgui-ws

Dear ImGui over WebSockets

llama.onnx

llama/alpaca onnx models, quantization and testcase

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

mmdeploy

OpenMMLab Model Deployment Framework

mmengine

OpenMMLab Foundational Library for Training Deep Learning Models

model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

myblog-django

My first time to create a blog using Django(not maintained anymore)

python_backend

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

pytorch_backend

The Triton backend for the PyTorch TorchScript models.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

tensorrt_backend

The Triton backend for TensorRT.

tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

third_party

Third-party source packages that are modified for use in Triton.

transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

tvm_walk_through

code reading for tvm