bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support for vLLM

noforit opened this issue · comments

Could you please inform me about when support might be available for VLLM accelerated inference?