4bit-quantize

There are 1 repository under 4bit-quantize topic.

shaheennabi / Production-Ready-Instruction-Finetuning-of-Meta-Llama-3.2-3B-Instruct-Project
Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations. Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning 🎋
4bit-quantize 4bitprecision anthropic-hh-golden bitsandbytes deployed finetuning gguf gpu huggingface inference meta modular-code open-source peft production-ready qlora quantization training unified-language-model-aligning unsloth
Language:Jupyter Notebook 23
michaelnny / QLoRA-LLM
A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
fine-tuning llm qlora custom-model llama 4bit-quantize
Language:Python 10
LuluW8071 / Llama2-LLM-7B-Text-Generation
Text Generation on Pre-Trained NousResearch’s Llama-2-7b-chat-hf using guanaco-llama2-1k dataset
4bit-quantize huggingface llama2 llm pytorch text-generation
Language:Jupyter Notebook 1
UlianaDzhumok / meeting_key_points_ai
Sample project with combination of Whisper and Deepseek R1 for extracting key points from office meeting videos
4bit-quantize ai deepseek-r1 dora finetuning llm lora quantization speech-to-text summarization unsloth whisper whisper-ai transformers
Language:Jupyter Notebook

shaheennabi / Production-Ready-Instruction-Finetuning-of-Meta-Llama-3.2-3B-Instruct-Project