edgarbc / only_local_llama

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

only_local_llama

Edgar Bermudez - edgar.bermudez@gmail.com

May, 2024.

Description

Example how to use llama locally (not needed an internet connection using ollama).

This is adapted from https://www.youtube.com/watch?v=_dDaNgBDoHY&t=460s

Installation

  • create a conda environment:

conda create -n local_llama -p 3.10

  • activate your environment

conda activate local_llama

  • install requirements

pip install requiremets.txt

  • install ollama

Follow the instructions from ollama.com

  • install llama3 using ollama

ollama pull llama3

About

License:MIT License


Languages

Language:Python 100.0%