tonymm55 / langchain-groq-chainlit

Simple Chainlit UI for running llms from Groq and LangChain

langchain-groq-chainlit

Simple Chat UI using Large Language Model Groq, LangChain and Chainlit

Tech stack being used

• LLMs from Groq website.
• LangChain as a Framework for LLM
• LangSmith for developing, collaborating, testing, deploying, and monitoring LLM applications.
• Chainlit for deploying.

System Requirements

You must have Python 3.10 or later installed. Earlier versions of python may not compile.

Steps to Replicate

1. Fork this repository (optional) and clone it locally.

   git clone https://github.com/sudarshan-koirala/langchain-groq-chainlit.git
   cd langchain-groq-chainlit
   

2. Create a virtualenv and activate it.

   python3 -m venv .venv && source .venv/bin/activate
   

3. OPTIONAL - Rename example.env to .env with cp example.env .envand input the environment variables from LangSmith. You need to create an account in LangSmith website if you haven't already. Also, you need to get api key for groq from this link.

   LANGCHAIN_TRACING_V2=true
   LANGCHAIN_ENDPOINT="https://api.smith.langchain.com"
   LANGCHAIN_API_KEY="your-api-key"
   LANGCHAIN_PROJECT="your-project"
   GROQ_API_KEY="YOUR_GROQ_API_KEY"
   

4. Run the following command in the terminal to install necessary python packages:

   pip install -r requirements.txt
   

5. Run the following command in your terminal to start the chat UI:

   chainlit run langchain_groq_chainlit.py