Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

Home Page:https://llamafile.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Terminated by signal SIGILL (Illegal instruction)

DjagbleyEmmanuel opened this issue · comments

commented

Trying to run Phi and i got this error './llamafile-0.8.1 -m phi-2-unce…' terminated by signal SIGILL (Illegal instruction)
Even after conversion to llamafile, i still got this error.
Someone kindly explain to me why please, thank you

me too - Ubuntu 23.10 -
Command: "./llava-v1.5-7b-q4.llamafile"
script ends with "illegal instruction"

Last lines in log:

[1714233021] [llama.cpp/llava/clip.cpp:  143][             get_key_idx] key clip.vision.mm_patch_merge_type not found in file
[1714233021] [llama.cpp/llava/clip.cpp:  143][             get_key_idx] key clip.vision.image_crop_resolution not found in file
[1714233021] [llama.cpp/llava/clip.cpp: 1308][         clip_model_load] clip_model_load: compute allocated memory: 32.89 MB
[1714233022] warming up the model with an empty run