SunixLiu / LLaMA-8bit-LoRA

Repository for Chat LLaMA - training a LoRA for the LLaMA model on HuggingFace with 8-bit quantization. Research only.

Chat LLaMA

8bit-LoRA

Repository for training a LoRA for the LLaMA model on HuggingFace with 8-bit quantization. Research only.


👉 Join our Discord Server for updates, support & collaboration

Dataset creation, training, weight merging, and quantization instructions are in the docs.

Check out our trained LoRAs on HuggingFace

Anthropic's HH

• 7B
• 13B
• 30B