LLM inference in C/C++
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
nekiee13 opened this issue a month ago · comments
Hello,
Is it possible to implement Llamacpp support for this great translation model from Google? Google already made GGUFs (q4 and q6)?
google/madlad400-10b-mt
https://huggingface.co/google/madlad400-10b-mt/tree/main