More LLava style models: https://github.com/Meituan-AutoML/MobileVLM and https://github.com/vikhyat/moondream
kinchahoy opened this issue · comments
kinchahoy commented
Could we get LLamafiles for a few more small scale (i.e. ARM friendly) LLava models? If there are instructions to use the LLava 1.5 file to load projection weights from those models that would be just as useful!
Ma Mana ma Manama commented
Not sure what you mean, but these Llava models have been working fine on my Droid for +2 months. Just use their GGUF versions, e.g. https://huggingface.co/ZiangWu/MobileVLM_V2-1.7B-GGUF, with the regular syntax.
kinchahoy commented
Do you have llamafiles for these models? Could you share?