PromtEngineer / localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

cpp-llama-python not found.

NitkarshChourasia opened this issue · comments

Whenever I try to ingest my documents. It shows me this error, WHY?

It also gives me the solution to pip install cpp-llama-python

Can someone tell me what this is used for in the current project?

Yes, llama-cpp-python is required for this program to work and you download it using pip install like you mentioned. It is a Python binding for llama-cpp and supports a number of hardware acceleration backends to speed up inference. cpp = C++ which is for efficient execution.