scaleapi / llm-engine

Scale LLM Engine public repository

https://llm-engine.scale.com

GQA for Llama 2 7B and 13B models

yunfeng-scale opened this issue a year ago · comments

Yunfeng Bai commented a year ago