This is a quick demo of how to get a fully local model up and running with Mixtral 8x7b and LlamaIndex; check out the accompanying blog post for more details.
poetry shell
poetry install
After you've downloaded Ollama and run ollama run mixtral run this to make sure everything is connected.
This will index the data in the data folder. You can run this as many times as you want, and it will only index new data.
This demonstrates the working index without re-loading the documents.
A very simple Flask app that demonstrates how to use the index in a web app. Note that flask run will not work; you must run python app.py.