0-hero / vllm-experiments

Official VLLM Implementation is available for mixtral. This version supports the DiscoLM mixtral models

https://docs.vllm.ai

Geek Repo

Github PK Tool