leoneversberg / codellama-chatbot

A local LLM chatbot using Code Llama

Home Page:https://medium.com/towards-artificial-intelligence/how-to-build-your-own-llm-coding-assistant-with-code-llama-04d8340900a3

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

codellama-chatbot

A local LLM chatbot using CodeLlama-7b-Instruct-hf

Screenshot

Dependencies

  • torch
  • transformers
  • bitsandbytes
  • accelerate
  • streamlit

Running the chatbot

streamlit run app.py