Thank you for this!
CyberTimon opened this issue · comments
It deserves way more attention. I really needed an api without the full oobabooga
thanks
mzbac / GPTQ-for-LLaMa-API
Provide a way to use the GPT-QLLama model as an API
Provide a way to use the GPT-QLLama model as an API
CyberTimon opened this issue · comments
It deserves way more attention. I really needed an api without the full oobabooga
thanks