Giters

sgl-project / sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Fails with latest vllm

benglard opened this issue · comments

commented

sglang is installing the latest vllm, looks like this file was removed from vllm 0.4.0

ModuleNotFoundError: No module named 'vllm.model_executor.input_metadata

commented

I had the same problem in #350. You must build sglang from source or wait till the fix gets put into a release