Illia-the-coder / Chat-with-Llama-2-70b-streamlit

This Space demonstrates model Llama-2-70b-chat-hf by Meta, a Llama 2 model with 70B parameters fine-tuned for chat instructions.

Home Page:https://llama-2-70b.streamlit.app/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Chat with Llama 2-70b using Streamlit

This repository contains a Streamlit application that allows users to interact with the Llama 2-70b Chatbot model from Hugging Face. The application provides a user-friendly interface to chat with the model and adjust certain parameters to influence the model's responses.

Features

  • Chat interface to communicate with Llama 2-70b.
  • Adjustable parameters like temperature and max new tokens for fine-tuning the model's responses.
  • Persistent chat history for the duration of the session.
  • Sidebar for adjusting model parameters.

Installation & Usage

  1. Clone the repository:

    git clone https://github.com/Illia-the-coder/Chat-with-Llama-2-70b-streamlit.git
    cd Chat-with-Llama-2-70b-streamlit
  2. Install the required packages:

    pip install -r requirements.txt
  3. Run the Streamlit app:

    streamlit run streamlit_app.py
  4. Open the provided link in your browser to interact with the application.

Repository Structure

  • streamlit_app.py: The main Streamlit application script.
  • requirements.txt: Contains the list of required packages for the project.
  • Add other files or directories as needed.

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

License

MIT

About

This Space demonstrates model Llama-2-70b-chat-hf by Meta, a Llama 2 model with 70B parameters fine-tuned for chat instructions.

https://llama-2-70b.streamlit.app/


Languages

Language:Python 100.0%