LiuYuWei / Llama-2-cpp-example

An example to run Llama 2 cpp python in Colab environment.

Llama-2-cpp-example

An example to run Llama 2 cpp python in Colab environment.

Link:

Part 1: How to use llama 2 Colab Link: Link

Part 2: How to let llama 2 Model as a Fastapi Service Colab Link: Link

Part 3: How to let mistral 7b Model as a Fastapi Service Colab Link: Link

Course:

• Demo 1 - GGUF example code: Colab Link: Link

• Demo 2 - Embedding Vector and RAG: Colab Link: Link

• Demo 3 - Let mistral 7b Model as a Fastapi Service Colab Link: Link