Giters

hpcaitech / EnergonAI

Large-scale model inference.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Provide a docker service

feifeibear opened this issue · comments

commented

Package the EnergonAI into a docker image.
After the image is launched, it provides a OPT service via HTTP or RPC.