tensorrt-inference-server

There are 0 repository under tensorrt-inference-server topic.

cap-ntu / ML-Model-CI
MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
serving deep-learning continuous-integration inference convert-models dispatcher profiler tensorflow-serving onnx pytorch tensorrt tensorrt-inference-server mlops
Language:Python 188
DataXujing / TensorRT_CV
:rocket::rocket::rocket:NVIDIA TensorRT 加速推断教程！
cv tensorrt tensorrt-inference-server
Language:CSS 133
chiehpower / Setup-deeplearning-tools
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
tensorrt cuda cudnn installation onnxruntime onnx2trt onnx-simplifier agx pytorch tesseract-ocr triton-inference-server tensorrt-inference-server nvidia deep-learning ci docker triton-server paddleocr supervisord minio
Language:Python 44
rmccorm4 / TRTIS-Go-Client
🖧 Simple gRPC client in Go to communicate with TensorRT Inference Server
docker go golang gomodule grpc nvidia nvidia-docker tensorrt tensorrt-inference-server
Language:Go 4

cap-ntu / ML-Model-CI