Giters

guinmoon / llmfarm_core.swift

Swift library to work with llama and other large language models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Will you be adding support for mistral-7b-instruct-v0.1.Q4_K_M.gguf?

cyrilzakka opened this issue · comments

commented

Thanks for this wrapper. Do you think it'd be possible to add support for the new Mistral model? It seems to be working according to https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF. Otherwise I'll submit a pull request by this weekend.