Demo Retrieval Augmented Chatbot AI using open source components and SemaDB.
Install the Python dependencies:
pip install -r requirements.txt
Install Ollama as the main LLM:
https://ollama.com/download/ollama-linux-amd64 -o ollama
chmod +x ollama
Start the Ollama server:
ollama serve
and install the desired model:
ollama pull llama2
# Test using
ollama run llama2
then run the main.py
entry point with the SemaDB API Key:
SEMADB_API_KEY=... python3 main.py
- LangChain Used for gluing together components
- Gradio Web interface
- Ollama Main large language model library
- Sentence Transformers The embedding model