KyrieRui / BOP_LLaMA

research in Meta LLaMA7b in BOPRC

The BOP LLaMA is using locally running LLaMA2 7B Chat model,it using llama-cpp-python library and Graio for UI

conda create -n llm python=3.11

conda activate llm
python BOP_LLM_GradioUI.py

if Mac GPU (M1...) not using, try the following

pip uninstall llama-cpp-python
CMAKE_ARGS="-DLLAMA_METAL=on" pip install llama-cpp-python==0.2.27

The BOP_RAG using llama cpp provieded by langchain_community

This is the test demo csv in RAG file