VectorInstitute / vector-inference

Efficient LLM inference on Slurm clusters using vLLM.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

VectorInstitute/vector-inference Stargazers