Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

Home Page:https://llamafile.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Failed to load model, here's what came out 

DjagbleyEmmanuel opened this issue · comments

llama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.ffn_down.weight' not found
llama_load_model_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model 'phixtral-4x2_8odd.Q8_0.gguf'
{"function":"load_model","level":"ERR","line":447,"model":"phixtral-4x2_8odd.Q8_0.gguf","msg":"unable to load model","tid":"9442720","timestamp":1714935621}