instruction-tuning

There are 16 repositories under instruction-tuning topic.

LLaMA-Factory
hiyouga / LLaMA-Factory
Unify Efficient Fine-Tuning of 100+ LLMs
agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers
Language:Python 22130
haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
gpt-4 chatbot chatgpt llama multimodal llava foundation-models instruction-tuning multi-modality visual-language-learning llama-2 llama2 vision-language-model
Language:Python 16711
BradyFU / Awesome-Multimodal-Large-Language-Models
:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.
chain-of-thought in-context-learning instruction-following instruction-tuning large-language-models large-vision-language-model large-vision-language-models multi-modality multimodal-chain-of-thought multimodal-in-context-learning multimodal-instruction-tuning multimodal-large-language-models visual-chain-of-thought visual-in-context-learning visual-instruction-tuning
9369
RUCAIBox / LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
chain-of-thought chatgpt in-context-learning instruction-tuning large-language-models llm llms natural-language-processing pre-trained-language-models pre-training rlhf
Language:Python 8987
Instruction-Tuning-with-GPT-4 / GPT-4-LLM
Instruction Tuning with GPT-4
alpaca chatgpt gpt-4 instruction-tuning llama
Language:HTML 4000
yizhongw / self-instruct
Aligning pretrained language models with instruction data generated by themselves.
general-purpose-model instruction-tuning language-model
Language:Python 3817
Otter
Luodian / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
artificial-inteligence chatgpt deep-learning embodied-ai foundation-models gpt-4 instruction-tuning large-scale-models machine-learning multi-modality visual-language-learning
Language:Python 3464
NExT-GPT / NExT-GPT
Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
chatgpt foundation-models gpt-4 instruction-tuning large-language-models llm multi-modal-chatgpt multimodal visual-language-learning
Language:Python 2897
PhoebusSi / Alpaca-CoT
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！
chatglm llama llm lora chatgpt cot instruction-tuning alpaca moss p-tuning parameter-efficient pytorch tabul tabular-data tabular-model
Language:Jupyter Notebook 2487
PKU-YuanGroup / Video-LLaVA
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
instruction-tuning large-vision-language-model multi-modal
Language:Python 2467
DSXiangLi / DecryptPrompt
总结Prompt&LLM论文，开源数据&模型，AIGC应用
demonstration in-context-learning prompt few-shot-learning zero-shot-learning aigc papers prompt-tuning instruction-tuning chain-of-thought chatgpt llm llm-agent prompt-engineering
2157
X-PLUG / mPLUG-Owl
mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model
chatbot chatgpt large-language-models llama multimodal damo mplug instruction-tuning pretraining mplug-owl huggingface pytorch transformer alpaca visual-recognition gpt gpt4 gpt4-api dialogue video
Language:Python 1964
InternLM / InternLM-XComposer
InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.
chatgpt visual-language-learning multi-modality foundation gpt-4 instruction-tuning mllm multimodal vision-language-model language-model large-language-model large-vision-language-model llm vision-transformer gpt supervised-finetuning
Language:Python 1716
modelscope / data-juicer
A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！
data-analysis data-science dataset large-language-models llm nlp chinese data-visualization opendata gpt pytorch gpt-4 llama llms streamlit instruction-tuning pre-training multi-modal llava sora
Language:Python 1538
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1029
yaodongC / awesome-instruction-dataset
A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
awsome-lists datasets gpt-3 gpt-4 instruction-following instruction-tuning language-model llama
1009
OpenGVLab / InternVideo
Video Foundation Models & Data for Multimodal Understanding
foundation-models video-understanding vision-transformer action-recognition masked-autoencoder multimodal open-set-recognition spatio-temporal-action-localization temporal-action-localization video-question-answering video-retrieval zero-shot-classification zero-shot-retrieval benchmark contrastive-learning self-supervised instruction-tuning video-data video-dataset video-clip
Language:Python 982
DataDreamer
datadreamer-dev / DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
deep-learning machine-learning natural-language-processing nlp nlp-library python pytorch transformers alignment fine-tuning gpt instruction-tuning llm llmops llms openai synthetic-data synthetic-dataset-generation
Language:Python 671
bigscience-workshop / xmtf
Crosslingual Generalization through Multitask Finetuning
instruction-tuning large-language-models multitask-learning language-models bloom multilingual-nlp t5 bloomz mt0 zero-shot-learning
Language:Jupyter Notebook 496
salesforce / DialogStudio
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
conversational-ai dataset dialog language-model natural-language-understanding open-domain-dialog question-answering natural-language-generation open-source instruction-tuning
Language:Python 441
FudanDISC / DISC-FinLLM
DISC-FinLLM，中文金融大语言模型（LLM），旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.
chain-of-retrieval financial-large-language-model instruction-tuning retrieval-enhanced-generation tool-learning
Language:Python 440
HKUDS / GraphGPT
[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"
graph-neural-networks instruction-tuning large-language-models text-graph graph-learning
Language:Python 432
ContextualAI / gritlm
Generative Representational Instruction Tuning
embeddings grit information-retrieval instruction-tuning llm llms mteb retrieval sbert sgpt text-embedding embedding embedding-models
Language:Jupyter Notebook 405
RenzeLou / awesome-instruction-learning
Papers and Datasets on Instruction Tuning and Following. ✨✨✨
pretrained-language-model instruction-learning paper-list awesome-list datasets in-context-learning large-language-models prompt survey instruction instruction-tuning
Language:Python 405
HugAILab / HugNLP
CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊
code-understanding deep-learning few-shot-learning instruction-tuning large-language-models natural-language-processing prompt-based-learning pytorch transformers information-extraction hugchat
Language:Python 370
hkust-nlp / deita
Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
alignment data-centric instruction-tuning large-language-models
Language:Python 352
mindspore-courses / step_into_llm
MindSpore online courses: Step into LLM
llm natural-language-processing nlp large-language-models mindspore bert chatgpt codegeex gpt gpt2 instruction-tuning parallel-computing prompt-tuning rlhf chatglm chatglm2 llama llama2 moe peft
Language:Python 341
HenryHZY / Awesome-Multimodal-LLM
Research Trends in LLM-guided Multimodal Learning.
llm multimodal large-language-models multimodal-learning in-context-learning instruction-tuning multimodal-large-language-models parameter-efficient-learning parameter-efficient-tuning
333
ictnlp / BayLing
“百聆”是一个基于LLaMA的语言对齐增强的英语/中文大语言模型，具有优越的英语/中文能力，在多语言和通用任务等多项测试中取得ChatGPT 90%的性能。BayLing is an English/Chinese LLM equipped with advanced language alignment, showing superior capability in English/Chinese generation, instruction following and multi-turn interaction.
aigc bayling chatgpt chinese cross-lingual general-language-model gpt4 human-performance instruction-tuning interactive large-language-models llama machine-translation multilingual-translation translation
Language:Python 274
WangRongsheng / Aurora
🐳 Aurora is a [Chinese Version] MoE model. Aurora is a further work based on Mixtral-8x7B, which activates the chat capability of the model's Chinese open domain.
mixtral-8x7b-instruct mixtral mixtral-8x7b instruction-tuning lora qlora fine-tuning large-language-models llm gpt language-model chinese
Language:Python 254
zhilizju / Awesome-instruction-tuning
A curated list of awesome instruction tuning datasets, models, papers and repositories.
alpaca awesome awesome-list chatgpt cross-task-generalization gpt in-context-learning instruct-gpt instruction-tuning llm llms zero-shot
Language:Python 252
SALT-NLP / LLaVAR
Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
chatgpt gpt-4 llava multimodal ocr instruction-tuning vision-and-language chatbot
Language:Python 236
mlpc-ucsd / BLIVA
(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
blip2 bliva chatbot instruction-tuning llama llm lora multimodal visual-language-learning
Language:Python 230
princeton-nlp / LESS
Preprint: Less: Selecting Influential Data for Targeted Instruction Tuning
data data-selection influence instruction-tuning llama llm mistral
Language:Jupyter Notebook 227
raunak-agarwal / instruction-datasets
All available datasets for Instruction Tuning of Large Language Models
chatgpt gpt-3 gpt-4 instruction-tuning multi-task-learning alpaca dataset large-language-models sharegpt gpt4all open-assistant chain-of-thought
219
akoksal / LongForm
Reverse Instructions to generate instruction tuning data with corpus examples
instruction-tuning text-generation
197