joennlae / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

joennlae/worker-vllm Issues

No issues in this repository yet.