oldpan's repositories
Pytorch-Learn
Learn pytorch the hard way
common
Common source, scripts and utilities shared across all Triton repositories.
cyberdog_ros2
ROS 2 packages for CyberDog
DietCode
DietCode Code Release
discourse-chatbot
A cloud chatbot adaptor for Discourse, currently supporting OpenAI
gradio-chat
HuggingChat like UI in Gradio
llama.onnx
llama/alpaca onnx models, quantization and testcase
markdown-cv
a simple template to write your CV in a readable markdown file and use CSS to publish/print it.
mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
mmdeploy
OpenMMLab Model Deployment Framework
mmengine
OpenMMLab Foundational Library for Training Deep Learning Models
model_analyzer
Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.
myblog-django
My first time to create a blog using Django(not maintained anymore)
onnxruntime_backend
The Triton backend for the ONNX Runtime.
python_backend
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
pytorch_backend
The Triton backend for the PyTorch TorchScript models.
stable-fast
An ultra lightweight inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
tensorrt_backend
The Triton backend for TensorRT.
tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
transformer-deploy
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
tvm_walk_through
code reading for tvm