supervised-finetuning

There are 2 repositories under supervised-finetuning topic.

InternLM / InternLM-XComposer
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
chatgpt visual-language-learning multi-modality foundation gpt-4 instruction-tuning mllm multimodal vision-language-model language-model large-language-model large-vision-language-model llm vision-transformer gpt supervised-finetuning
Language:Python 2899
Tebmer / Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
alignment compression data-augmentation data-synthesis feedback instruction-following kd knowledge-distillation large-language-model llm multi-modal self-distillation self-training supervised-finetuning survey
1202
magpie-align / magpie
[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!
alignment dataset gemma llama2 llama3 llm nlp paper phi3 qwen2 supervised-finetuning synthetic-data synthetic-dataset-generation
Language:Python 786
GaryYufei / AlignLLMHumanSurvey
Aligning Large Language Models with Human: A Survey
chatgpt gpt-4 large-language-models llms rlhf supervised-finetuning survey awesome chinese-llama llama llama2
738
chaoswork / sft_datasets
开源SFT数据集整理,随时补充
datasets supervised-finetuning chinese-dataset large-language-models llms
557
KodCode-AI / kodcode
✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork
code-generation coding dataset large-language-models nlp paper supervised-finetuning synthetic-data synthetic-dataset-generation
Language:Python 274
YJiangcm / Lion
[EMNLP 2023] Lion: Adversarial Distillation of Proprietary Large Language Models
instruction-following knowledge-distillation large-language-models supervised-finetuning synthetic-dataset-generation
Language:Python 210
codelion / ellora
Enhancing LLMs with LoRA
accuracy-analysis fine-tuning finetuning lora qlora reinforcement-learning supervised-finetuning training chain-of-thought chain-of-thought-reasoning data-generation distillation finetuning-llms self-correction self-distillation fine-tune fine-tuning-llm quantization quantization-aware-training reasoning
Language:Jupyter Notebook 174
NVlabs / catk
Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models. CVPR Oral 2025.
autonomous-driving cvpr2025 imitation-learning next-token-prediction supervised-finetuning traffic-simulation waymo-open-dataset
Language:Python 157
LIN-SHANG / InstructERC
The offical realization of InstructERC
chatglm-6b chatglm2-6b emotion-recognition-in-conversation large-language-models llama-7b llama2-7b supervised-finetuning unified-data-processing
Language:Python 143
sail-sg / sdft
[ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
language-model self-distillation supervised-finetuning
Language:Shell 136
guanwei49 / LogLLM
LogLLM: Log-based Anomaly Detection Using Large Language Models (system log anomaly detection)
anomaly-detection large-language-models llm supervised-finetuning system-logs system-security
Language:Python 109
yyDing1 / ScaleQuest
[ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
dataset deepseek-math llama3 llms mathematics mistral nlp qwen2 supervised-finetuning synthetic-data
Language:Python 68
BUAADreamer / MLLM-Finetuning-Demo
使用LLaMA-Factory微调多模态大语言模型的示例代码 Demo of Finetuning Multimodal LLM with LLaMA-Factory
llama-factory llava mllm paligemma yi-vl finetune-llm lora huggingface-datasets transformers pretraining supervised-finetuning
Language:Python 53
liziniu / GEM
Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
cold-start distribution-matching diversity generalization large-language-models reasoning rl supervised-finetuning
Language:Python 42
ShiZhengyan / InstructionModelling
[NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
instruction-tuning language-model natural-language-processing supervised-finetuning
Language:Python 39
inst-it / inst-it
[NeurIPS 2025] The official repository of "Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning"
instruction-tuning large-multimodal-models multimodal multimodal-large-language-models supervised-finetuning
Language:Python 37
YJiangcm / LTE
[ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing
knowledge-editing large-language-models llama model-editing qwen alignment supervised-finetuning
Language:Python 36
AstraZeneca / vlm
Official implementation for "Diffusion Instruction Tuning"
multimodal-alignment multimodal-large-language-models post-training supervised-finetuning vision-language-model
Language:Python 28
quanshr / AugCon
[AAAI 2025]Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularity
large-language-model supervised-finetuning synthetic-data
Language:Python 26
fanqiwan / KCA
EMNLP'2024: Knowledge Verification to Nip Hallucination in the Bud
hallucination large-language-models machine-learning supervised-finetuning
Language:Python 21
BUAADreamer / Qwen2-VL-History
Qwen2-VL在文旅领域的LLaMA-Factory微调案例 The case for fine-tuning Qwen2-VL in the field of historical literature and museums
beauty history llama-factory mllm multimodal-large-language-models museum qwen2-vl supervised-finetuning
12
bhattbhavesh91 / google-gemma-finetuning-n2sql
Finetuning Google's Gemma Model for Translating Natural Language into SQL
fine-tuning finetuning finetuning-llms gemma google lora natural-language-to-sql supervised-finetuning
Language:Jupyter Notebook 11
YJiangcm / WebR
[ACL 2025] Instruction-Tuning Data Synthesis from Scratch via Web Reconstruction
instruction-tuning llms dataset nlp paper supervised-finetuning synthetic-data synthetic-dataset-generation
Language:Python 11
mirabdullahyaser / LLaMA3-Financial-Analyst
LLM-powered financial analyst using LoRA-tuned Llama-3 and RAG pipeline to answer complex queries over SEC 10-K filings with contextual accuracy.
embeddings fiass finance financial-analysis fine-tuning huggingface llama3 llm lora rag supervised-finetuning unsloth vector-database chatbot question-answering
Language:Jupyter Notebook 9
ethicalabs-ai / BlossomTuneLLM-MLX
Federated Fine-Tuning of LLMs on Apple Silicon with Flower.ai and MLX-LM
apple-silicon federated-learning flower-ai huggingface llm llms macosx mlx mlx-lm small-language-models supervised-finetuning
Language:Python 7
asifhaider / LLM-Finetuning-Prompting-Project
Python Project Sample for Demonstration
code-review instruction-following llama3 qlora bm25 few-shot-prompting gpt35turbo supervised-finetuning
Language:Jupyter Notebook 6
KwokHing / AI-Planet-LLM-Bootcamp-Challenge
An LLM challenge to (i) fine-tune pre-trained HuggingFace transformer model to build a Code Generation language model, and (ii) build a retrieval-augmented generation (RAG) application using LangChain
embeddings-model fine-tuning language-model llm mistral-7b qlora retrieval-augmented-generation sentence-embeddings transformer-models supervised-finetuning langchain ocra-mini-3b
Language:Jupyter Notebook 5
ranzeet013 / RLHF-CustomData
Building an LLM with RLHF involves fine-tuning using human-labeled preferences. Based on Learning to Summarize from Human Feedback, it uses supervised learning, reward modeling, and PPO to improve response quality and alignment.
fine-tuning flan-t5 policy-optimization-algorithms ppo-agent reinforcement-learning-algorithms reward-modeling supervised-finetuning transformer
Language:Jupyter Notebook 4
sovit-123 / lm_sft
Various LMs/LLMs below 3B parameters (for now) trained using SFT (Supervised Fine Tuning) for several downstream tasks
gemma gpt gpt2 large-language-models llms supervised-finetuning bert
Language:Jupyter Notebook 4
tien02 / llm-math
Fine tune Large Language Model on Mathematic dataset
huggingface llama llama2 llm lora mathematics supervised-finetuning transformer
Language:Python 4
ChryssaNab / ECG-Heartbeat-Classification
Binary classification of pathological heartbeats from ECG signals using 1D CNNs in PyTorch
1d-cnns binary-classification heartbeat-classification pytorch ecg-signals pre-trained-model transfer-learning supervised-finetuning
Language:Python 3
nsrinidhibhat / fine-tune-llama-2
This project streamlines the fine-tuning process, enabling you to leverage Llama-2's capabilities for your own projects.
fine-tuning huggingface large-language-models llama-2 open supervised-finetuning
Language:Python 3
ethicalabs-ai / BlossomTuneLLM
Federated Supervised Fine-Tuning for Small Language Models (SLMs)
federated-learning federated-learning-framework language-models large-language-models small-language-models supervised-finetuning transformers trl
Language:Python 2
Songjw133 / JOLT-SQL
[EMNLP 2025 Main] JOLT-SQL: Joint Loss Tuning of Text-to-SQL with Confusion-aware Noisy Schema Sampling
supervised-finetuning text-to-sql text2sql
Language:Python 2
YukinoshitaKaren / X_KDE
[ACL 2025 Findings] Edit Once, Update Everywhere: A Simple Framework for Cross-Lingual Knowledge Synchronization in LLMs
knowledge-editing llama qwen supervised-finetuning
Language:Python 2

supervised-finetuning

InternLM / InternLM-XComposer

Tebmer / Awesome-Knowledge-Distillation-of-LLMs

magpie-align / magpie

GaryYufei / AlignLLMHumanSurvey

chaoswork / sft_datasets

KodCode-AI / kodcode

YJiangcm / Lion

codelion / ellora

NVlabs / catk

LIN-SHANG / InstructERC

sail-sg / sdft

guanwei49 / LogLLM

yyDing1 / ScaleQuest

BUAADreamer / MLLM-Finetuning-Demo

liziniu / GEM

ShiZhengyan / InstructionModelling

inst-it / inst-it

YJiangcm / LTE

AstraZeneca / vlm

quanshr / AugCon

fanqiwan / KCA

BUAADreamer / Qwen2-VL-History

bhattbhavesh91 / google-gemma-finetuning-n2sql

YJiangcm / WebR

mirabdullahyaser / LLaMA3-Financial-Analyst

ethicalabs-ai / BlossomTuneLLM-MLX

asifhaider / LLM-Finetuning-Prompting-Project

KwokHing / AI-Planet-LLM-Bootcamp-Challenge

ranzeet013 / RLHF-CustomData

sovit-123 / lm_sft

tien02 / llm-math

ChryssaNab / ECG-Heartbeat-Classification

nsrinidhibhat / fine-tune-llama-2

ethicalabs-ai / BlossomTuneLLM

Songjw133 / JOLT-SQL

YukinoshitaKaren / X_KDE