parameter-efficient-tuning

There are 10 repositories under parameter-efficient-tuning topic.

adapter-hub / adapters
A Unified Library for Parameter-Efficient and Modular Transfer Learning
adapters bert lora natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning pytorch transformers
Language:Jupyter Notebook 2425
ttengwang / Awesome_Prompting_Papers_in_Computer_Vision
A curated list of prompt-based paper in computer vision and vision-language learning.
prompt-learning adapter few-shot-learning prompt-tuning zero-shot-learning visual-prompt parameter-efficient-tuning
867
Paranioar / Awesome_Cross_Modal_Pretraining_Transfering
The Paper List of Cross-Modal Matching / Pretraining / Transfering for Preliminary Insight.
cross-modal-retrieval tutorial visual-semantic-embeddings awesome-list parameter-efficient-tuning vision-and-language-pre-training large-multimodal-models
347
jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning
A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
computer-vision deep-learning machine-learning multimodal-deep-learning parameter-efficient-learning parameter-efficient-tuning transfer-learning
345
HenryHZY / Awesome-Multimodal-LLM
Research Trends in LLM-guided Multimodal Learning.
in-context-learning instruction-tuning large-language-models llm multimodal multimodal-large-language-models multimodal-learning parameter-efficient-learning parameter-efficient-tuning
334
JieShibo / PETL-ViT
[ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
parameter-efficient-tuning pytorch transfer-learning visual-prompting
Language:Python 162
calpt / awesome-adapter-resources
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
adapters deep-learning natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning transformers awesome peft
Language:Python 156
changdaeoh / BlackVIP
Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
black-box-optimization foundation-models parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting
Language:Python 99
eric-ai-lab / PEViT
Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"
fine-tuning image-classification parameter-efficient-tuning pytorch vision-transformer
Language:Python 93
thunlp / Prompt-Transferability
On Transferability of Prompt Tuning for Natural Language Processing
nlp parameter-efficient-learning pretrained-language-model pretrained-language-models pretrained-models prompt prompt-tuning pytorch transfer-learning parameter-efficient-tuning
Language:Python 89
ZhengxiangShi / DePT
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
fine-tuning language-model large-language-models natural-language-processing parameter-efficient-tuning peft prompt-tuning parameter-efficient-fine-tuning nlp nlp-machine-learning transfer-learning
Language:Python 83
WillDreamer / Aurora
[NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model
multi-modal-learning parameter-efficient-tuning
Language:Python 76
morningmoni / UniPELT
Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
parameter-efficient-tuning
Language:Python 57
Paranioar / UniPT
[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
cross-modal parameter-efficient-learning parameter-efficient-tuning transfer-learning memory-efficient-learning memory-efficient-tuning
Language:Python 52
LeapLabTHU / Cross-Modal-Adapter
[arXiv] Cross-Modal Adapter for Text-Video Retrieval
adapter clip deep-learning machine-learning parameter-efficient-learning parameter-efficient-tuning pytorch video-text-retrieval vision-and-language
51
zhangyikaii / LAMDA-ZhiJian
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
knowledge-distillation model-merging model-reuse parameter-efficient-tuning pre-trained-model regularization toolbox
Language:Python 45
ImKeTT / AdaVAE
[Preprint] AdaVAE: Exploring Adaptive GPT-2s in VAEs for Language Modeling PyTorch Implementation
gpt-2 nlp parameter-efficient-tuning representation-learning vae controllable-generation text-classification text-generation variational-autoencoder
Language:Python 32
bighuang624 / VoP
[CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval
parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting cvpr2023
31
ZO-Bench / ZO-LLM
[ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
large-language-models parameter-efficient-tuning zeroth-order-optimization
Language:Python 28
westlake-repl / Adapter4Rec
Multi-domain Recommendation with Adapter Tuning
adapter cross-domain cross-domain-recommendation fine-tuning foundation-recommendation-model multi-domain-recommendation parameter-efficient-tuning prompt-tu transferable-recommendation lora-recommendation large-language-model llm4rec multi-domain-learning pre-train-recommendation recommender-sytem adapter-recommendation
Language:Python 22
Allen0307 / AdapterBias
Code for the Findings of NAACL 2022(Long Paper): AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks
adapter parameter-efficient-tuning transformers nlp
Language:Python 18
gauss5930 / AlpaGasus2-QLoRA
This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!
alpaca huggingface huggingface-transformers llama2 lora parameter-efficient-tuning peft qlora transformer
Language:Python 14
yunqing-me / AdAM
[NeurIPS-2022] Annual Conference on Neural Information Processing Systems
few-shot-adaptation gan generative-adversarial-network generative-ai parameter-efficient-tuning pytorch transfer-learning
Language:Python 14
adarobustness / adaptation_robustness
Evaluate robustness of adaptation methods on large vision-language models
adaptation parameter-efficient-tuning robustness vision-language-pretraining
Language:Shell 13
siyi-wind / AViT
[MICCAI ISIC Workshop 2023] AViT: Adapting Vision Transformers for Small Skin Lesion Segmentation Datasets (an official implementation)
deep-learning parameter-efficient-tuning skin-lesion-segmentation transfer-learning vision-transformer pytorch
Language:Python 13
auniquesun / PPT
[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"
parameter-efficient-fine-tuning parameter-efficient-tuning point-cloud-analysis point-cloud-recognition prompt-learning 3d-point-cloud point-cloud-understanding 3d-shape-part-segmentation 3d-shape-analysis
Language:Jupyter Notebook 12
WHU-ZQH / PANDA
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
knowledge-distillation parameter-efficient-tuning
Language:Python 11
declare-lab / domadapter
Code for EACL'23 paper "Udapter: Efficient Domain Adaptation Using Adapters"
adapters domain-adaptation parameter-efficient-learning parameter-efficient-tuning
Language:Python 9
kEffNetV1
joaopauloschuler / kEffNetV1
This repository contains the source code for the paper "Grouped Pointwise Convolutions Reduce Parameters in Convolutional Neural Networks".
parameter-efficient parameter-efficient-learning parameter-efficient-tuning keras-models keras-cnn keras-deep-learning keras-jupyter-notebook keras-model keras-neural-network keras-tutorials keras-efficientnet keras-mobilenet
Language:Jupyter Notebook 6
pha123661 / NTU-2022Fall-ADL
Applied Deep Learning 深度學習之應用 by Vivian Chen 陳縕儂 at NTU CSIE
adl deep-learning natural-language-processing ntu multimodal-deep-learning parameter-efficient-tuning prompt-tuning question-answering seq2seq sequence-classification sequence-labeling summarization token-classification policy-gradient reinforcement-learning
Language:Python 6
yejoon-lee / kr3
KR3: Korean Restaurant Review with Ratings / Experiments on Parameter-efficient Tuning and Task-adaptive Pre-training
dataset korean korean-nlp nlp sentiment-classification bert bert-fine-tuning huggingface-transformers parameter-efficient-tuning sentiment-analysis adapter lora natural-language-processing pretraining text-classification transfer-learning transformers
Language:Jupyter Notebook 5
daskol / lotr
Low Tensor Rank adaptation of large language models
fine-tuning llm lora lotr parameter-efficient-tuning peft
Language:Python 4
gimpong / ICCV23-IDPT
The code for the paper "Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models" (ICCV'23).
3d-classification 3d-models 3d-segmentation parameter-efficient-tuning point-cloud pretrained-models prompt-tuning iccv2023
Language:Python 4
louisc-s / QLoRA-Fine-tuning-for-Film-Character-Styled-Responses-from-LLM
Code for fine-tuning Llama2 LLM with custom text dataset to produce film character styled responses
chatbot deep-learning finetuning-llms llama2 lora parameter-efficient-tuning peft qlora generative-ai
Language:Python 4
Jaso1024 / Self-Attention-Factor-Tuning
Code for SAFT: Self-Attention Factor-Tuning, a 16x more efficient solution for fine-tuning neural networks
fine-tuning neural-network neural-networks parameter-efficient-tuning vision-transformer
Language:Python 2
adarobustness / corruption
The code for generating natural distribution shifts on image and text datasets.
multimodal parameter-efficient-tuning robustness vision-language
Language:Python 1

parameter-efficient-tuning

adapter-hub / adapters

ttengwang / Awesome_Prompting_Papers_in_Computer_Vision

Paranioar / Awesome_Cross_Modal_Pretraining_Transfering

jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning

HenryHZY / Awesome-Multimodal-LLM

JieShibo / PETL-ViT

calpt / awesome-adapter-resources

changdaeoh / BlackVIP

eric-ai-lab / PEViT

thunlp / Prompt-Transferability

ZhengxiangShi / DePT

WillDreamer / Aurora

morningmoni / UniPELT

Paranioar / UniPT

LeapLabTHU / Cross-Modal-Adapter

zhangyikaii / LAMDA-ZhiJian

ImKeTT / AdaVAE

bighuang624 / VoP

ZO-Bench / ZO-LLM

westlake-repl / Adapter4Rec

Allen0307 / AdapterBias

gauss5930 / AlpaGasus2-QLoRA

yunqing-me / AdAM

adarobustness / adaptation_robustness

siyi-wind / AViT

auniquesun / PPT

WHU-ZQH / PANDA

declare-lab / domadapter

joaopauloschuler / kEffNetV1

pha123661 / NTU-2022Fall-ADL

yejoon-lee / kr3

daskol / lotr

gimpong / ICCV23-IDPT

louisc-s / QLoRA-Fine-tuning-for-Film-Character-Styled-Responses-from-LLM

Jaso1024 / Self-Attention-Factor-Tuning

adarobustness / corruption