Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
kathir-ks opened this issue 6 months ago · comments
How to train a Llama using TPUs?
