IEIT-Yuan / Yuan2.0-M32

Mixture-of-Experts (MoE) Language Model

IEIT-Yuan/Yuan2.0-M32 Issues

vllm推理无法启动NameError: name 'tokenizer_revision' is not defined
Updated 16 days ago
使用vLLM推理框架对Yuan2.0进行推理，开启tp并行且enforce_eager=True时推理结果有误
Updated 19 days ago1
There is no chat template in VLLM deploy.
Updated 2 months ago1
Is there any forward plain to support llama.cpp?
Updated 2 months ago4
llama-cpp-python推理时报错
Closed 2 months ago4
不太懂，这个attention在做什么
Closed 2 months ago1