amogh18t / RAGbot

Building Generative AI application using Retrieval Augmented Generation(RAG) using Mistral 7B LLM, LangChain orchestration framework & In memory vector database FAISS (Facebook AI Similarity Search)

Use Window Powershell to run following steps

Step 1: Install WSL(Windows Subsystem for Linux)

wsl --install

Step 2: List the different Linux Distribution that you can choose to install

wsl.exe -l -o

Step 3: install Linux distribtion received from above command example as below Ubuntu-22.04

wsl.exe --install Ubuntu-22.04

Step 4: Install Ollama at WSL

curl https://ollama.ai/install.sh | sh

Step 5: Run Opensource LLM a per your choice example as below using mistral LLM

ollama run mistral

Step 5: Ask LLM question and get answer :)

Now you can ask question from LLM to get response at Windows powershell terminal.

Future work is where you can run that as API endpoint at Google Collab, VSCode and Ollama it's own chat interface.