Magicoder-S-DS-6.7B gguf, gptq models are not working. Please could you provide quantize models. LM studio, text generation web ui is not is not working.
MrBenzWorld opened this issue · comments
you should check out these models they should work with text-generation-webui by oobabooga i just couldnt setup the promt template