LeslieZhoa / Triton-Torch-Custom

Triton-Pytorch Custom operator tutorial

Triton-Pytorch Custom operator tutorial

teach you how to run pytorch Custom operator in triton.
english_version 中文版本

precondition

you can install nvidia-docker by nvidia-docker-install.sh

Discription

stylegan fused_bias_act,pytorch1.6,cuda11 For example

structure

• Make-Model
  
  • Compiling dynamic link libraries
  • Packaging model .pt， file
• Triton-Serve
  
  • Service deployment

Use steps

• enter Make-Model folder and package related models
• enter Triton-Serve folder and deployment service

ADD Swap2p

enter Swap2P