从transformers推理切换到vllm推理效果变差
HIT-Owen opened this issue · comments
个人感觉和vllm的chat_template有关,参考QwenLM/Qwen#728 vllm-project/vllm#2051 这两个网页
Yi-1.5 is an upgraded version of Yi, delivering stronger performance in coding, math, reasoning, and instruction-following capability.
HIT-Owen opened this issue · comments
个人感觉和vllm的chat_template有关,参考QwenLM/Qwen#728 vllm-project/vllm#2051 这两个网页