Request : Api Integration - Oobabooga
Curiosity007 opened this issue · comments
As this is yet to support GPTQ models, maybe you can extend the functionality by adding api support of textgen webui? Textgen Webui can load GPTQ model and can expose API
Infinitely seconding