Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

Home Page:https://llamafile.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Fails to load custom UI on Apple Silicon (M1 Pro) - Shows "File not found" on localhost:8080

towardmay opened this issue · comments

Version: llamafile v0.8.1 (same issue since 0.7.x, earlier version 0.6.2 works perfectly fine)
This issues only exists if you use llamafile with external weights and with your own UI

Eg: ./llamafile -m mistral.gguf -ngl 9999 --server --nobrowser -ngl 9999 --ctx-size 2048 --path ./ui

Everything works perfectly fine of Intel Mac but on M1 it starts fine and then on localhost:8080 llama server simply renders 'File not found'. This custom UI is nothing more than just a simple index.html

Older llamafile version 0.6.2 with the exact command shown above works perfectly fine on Intel and M1.