There are 1 repository under 4bit-quantize topic.
Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations. Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning 🎋
A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
Text Generation on Pre-Trained NousResearch’s Llama-2-7b-chat-hf using guanaco-llama2-1k dataset
Sample project with combination of Whisper and Deepseek R1 for extracting key points from office meeting videos