Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

Home Page:https://llamafile.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

More LLava style models: https://github.com/Meituan-AutoML/MobileVLM and https://github.com/vikhyat/moondream

kinchahoy opened this issue · comments

Could we get LLamafiles for a few more small scale (i.e. ARM friendly) LLava models? If there are instructions to use the LLava 1.5 file to load projection weights from those models that would be just as useful!

Not sure what you mean, but these Llava models have been working fine on my Droid for +2 months. Just use their GGUF versions, e.g. https://huggingface.co/ZiangWu/MobileVLM_V2-1.7B-GGUF, with the regular syntax.

Do you have llamafiles for these models? Could you share?