thomasantony / llamacpp-python

Python bindings for llama.cpp

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

unable to convert

chaltik opened this issue · comments

Trying to test the simplest example, I cloned the llama 7b repo, created subfolder models/7B and copied the files there. After this trying to follow the instructions, getting sigfault:
`
(ai) karen@HAL-9000:~/anaconda3/envs/ai/lib/python3.10/site-packages/llamacpp$ ls models/7B/

config.json pytorch_model-00002-of-00002.bin special_tokens_map.json
generation_config.json pytorch_model.bin.index.json tokenizer_config.json
pytorch_model-00001-of-00002.bin README.md tokenizer.model

(ai) karen@HAL-9000:~/anaconda3/envs/ai/lib/python3.10/site-packages/llamacpp$ llamacpp-convert ./models/7B/ 1
Illegal instruction (core dumped)
`
perhaps it's just a matter of me not understanding what needs to be done. This is a CPU box with 24GB RAM