peft

There are 9 repositories under peft topic.

LLaMA-Factory
hiyouga / LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
agent ai deepseek fine-tuning gemma gpt instruction-tuning large-language-models llama llama3 llm lora moe nlp peft qlora quantization qwen rlhf transformers
Language:Python 62041
huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion fine-tuning llm lora parameter-efficient-learning peft python pytorch transformers
Language:Python 20001
modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v, Phi4, ...) (AAAI 2025).
deepseek-r1 embedding grpo internvl liger llama llama4 llm lora megatron moe multimodal open-r1 peft qwen3 qwen3-next qwen3-omni qwen3-vl reranker sft
Language:Python 10939
yangjianxin1 / Firefly
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
alpaca aquila baichuan chatglm gemma gpt internlm llama llama2 llama3 llm lora minicpm mistral mixtral peft qlora qwen qwen2 zephyr
Language:Python 6582
mymusise / ChatGLM-Tuning
基于ChatGLM-6B + LoRA的Fintune方案
chatglm chatgpt lora peft
Language:Python 3769
hiyouga / ChatGLM-Efficient-Tuning
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
chatglm chatgpt fine-tuning lora alpaca peft huggingface language-model transformers pytorch rlhf chatglm2 qlora
Language:Python 3722
zyds / transformers-code
手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube
huggingface peft transformers
Language:Jupyter Notebook 3468
ashishpatel26 / LLM-Finetuning
LLM Finetuning with peft
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Language:Jupyter Notebook 2692
stochasticai / xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
adapter deep-learning fine-tuning finetuning gen-ai generative-ai gpt-2 gpt-j language-model llama llm lora mistral mixed-precision peft quantization
Language:Python 2662
lxe / simple-llm-finetuner
Simple UI for LLM Model Finetuning
ai gpt-2 gpt-3 huggingface huggingface-transformers llama llm peft pytorch
Language:Jupyter Notebook 2065
X-LANCE / SLAM-LLM
A Framework for Speech, Language, Audio, Music Processing with Large Language Model
audio-processing large-language-model multimodal-large-language-models music-processing peft speech-processing
Language:Python 914
ModelCloud / GPTQModel
LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
gptq optimum peft quantization sglang transformers vllm
Language:Python 864
dvgodoy / FineTuningLLMs
Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"
bitsandbytes fine-tuning finetuning finetuning-llms hugging-face huggingface large-language-models llamacpp lora ollama peft peft-fine-tuning-llm pytorch transformers
Language:Jupyter Notebook 550
mindspore-courses / step_into_llm
MindSpore online courses: Step into LLM
llm natural-language-processing nlp large-language-models mindspore bert chatgpt codegeex gpt gpt2 instruction-tuning parallel-computing prompt-tuning rlhf chatglm chatglm2 llama llama2 moe peft
Language:Jupyter Notebook 478
LLaMA-LoRA-Tuner
zetavg / LLaMA-LoRA-Tuner
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
alpaca alpaca-lora llama lora machine-learning google-colab gpt-j gpt ai peft language-model
Language:Python 475
Guitaricet / relora
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
deep-learning distributed-training llama nlp peft transformer
Language:Jupyter Notebook 467
Joyce94 / LLM-RLHF-Tuning
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
fine-tuning language-model llama llm lora peft ppo reinforcement-learning rlhf
Language:Python 437
GraphPKU / PiSSA
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
fine-tuning peft quantization
Language:Jupyter Notebook 381
km1994 / llms_paper
该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）
agent llms lora peft qa rag
362
TUDB-Labs / mLoRA
An Efficient "Factory" to Build Multiple LoRA Adapters
baichuan chatglm dpo finetune gpu llama llama2 llm lora mlora peft rlhf
Language:Python 355
iamarunbrahma / finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
chatbot qlora fine-tuning llm lora peft falcon falcon-7b mental-health conversational-ai chatbots healthcare
Language:Jupyter Notebook 261
jasonvanf / llama-trl
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
adapter gpt llama lora peft ppo rlhf trl chatgpt transformer gpt-4
Language:Python 228
jackaduma / Vicuna-LoRA-RLHF-PyTorch
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna
chatgpt finetune gpt llama llm lora peft ppo pytorch reward-models rlhf vicuna vicuna-7b
Language:Python 219
calpt / awesome-adapter-resources
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
adapters deep-learning natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning transformers awesome peft
Language:Python 197
liuqidong07 / MOELoRA-peft
[SIGIR'24] The official implementation code of MOELoRA.
chatglm large-language-models low-rank-adaptation mixture-of-experts multi-task multitask-learning parameter-efficient-fine-tuning peft peft-fine-tuning-llm
Language:Python 184
jackaduma / ChatGLM-LoRA-RLHF-PyTorch
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
chatglm chatglm-6b chatgpt deepspeed finetune gpt llama llm lora peft ppo pytorch reward-models rlhf
Language:Python 138
Facico / GOAT-PEFT
[ICML2025] Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment
goat icml lora moe peft svd loramoe make-lora-great-again peftmoe fine-tuning
Language:Python 132
sandy1990418 / Finetune-Qwen2.5-VL
Fine-tuning Qwen2.5-VL for vision-language tasks | Optimized for Vision understanding | LoRA & PEFT support.
finetune-llm vlm ai lora peft llama-factory llm machine-learning
Language:Python 127
TUDB-Labs / MoE-PEFT
An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
mixlora mlora peft peft-fine-tuning-llm
Language:Python 127
Genome_Factory
MAGICS-LAB / Genome_Factory
An Integrated Library for Tuning, Deploying and Interpreting Genomic Models
fine-tuning foundation-models genomics large-language-models lora peft training
Language:Python 117
BorealisAI / flora-opt
This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
deep-learning flax jax large-language-models lora memory-efficient-tuning optax peft random-projection transformers
Language:Python 104
ShiZhengyan / DePT
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
fine-tuning language-model large-language-models natural-language-processing parameter-efficient-tuning peft prompt-tuning parameter-efficient-fine-tuning nlp nlp-machine-learning transfer-learning
Language:Python 98
Simplifine-gamedev / Simplifine
🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
ai cloud fine-tuning fine-tuning-llm finetuning-llms gpt instruction-tuning large-language-models llama llama3 llm llm-training lora mistral moe open-source peft phi qwen
Language:Python 95
kamalkraj / e5-mistral-7b-instruct
Finetune mistral-7b-instruct for sentence embeddings
finetuning huggingface lora mistral-7b peft pytorch sentence-embeddings transformers
Language:Python 87
NisaarAgharia / Indian-LawyerGPT
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
falcon fine-tuning gpt huggingface-transformers llms peft qlora large-language-models llama llama2
Language:Jupyter Notebook 86
TuGraph-family / Awesome-Text2GQL
Fine-Tuning Dataset Auto-Generation for Graph Query Languages.
hacktoberfest awesome-list fine-tuning graphdb llm text2gql text2sql peft sft
Language:Python 75

peft

hiyouga / LLaMA-Factory

huggingface / peft

modelscope / ms-swift

yangjianxin1 / Firefly

mymusise / ChatGLM-Tuning

hiyouga / ChatGLM-Efficient-Tuning

zyds / transformers-code

ashishpatel26 / LLM-Finetuning

stochasticai / xTuring

lxe / simple-llm-finetuner

X-LANCE / SLAM-LLM

ModelCloud / GPTQModel

dvgodoy / FineTuningLLMs

mindspore-courses / step_into_llm

zetavg / LLaMA-LoRA-Tuner

Guitaricet / relora

Joyce94 / LLM-RLHF-Tuning

GraphPKU / PiSSA

km1994 / llms_paper

TUDB-Labs / mLoRA

iamarunbrahma / finetuned-qlora-falcon7b-medical

jasonvanf / llama-trl

jackaduma / Vicuna-LoRA-RLHF-PyTorch

calpt / awesome-adapter-resources

liuqidong07 / MOELoRA-peft

jackaduma / ChatGLM-LoRA-RLHF-PyTorch

Facico / GOAT-PEFT

sandy1990418 / Finetune-Qwen2.5-VL

TUDB-Labs / MoE-PEFT

MAGICS-LAB / Genome_Factory

BorealisAI / flora-opt

ShiZhengyan / DePT

Simplifine-gamedev / Simplifine

kamalkraj / e5-mistral-7b-instruct

NisaarAgharia / Indian-LawyerGPT

TuGraph-family / Awesome-Text2GQL