parameter-efficient-learning

There are 9 repositories under parameter-efficient-learning topic.

huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion llm lora parameter-efficient-learning python pytorch transformers
Language:Python 15562
adapter-hub / adapters
A Unified Library for Parameter-Efficient and Modular Transfer Learning
adapters bert lora natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning pytorch transformers
Language:Jupyter Notebook 2506
THUDM / P-tuning-v2
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
natural-language-processing prompt-tuning pretrained-language-model p-tuning parameter-efficient-learning
Language:Python 1952
thunlp / OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
nlp nlp-library pretrained-language-model parameter-efficient-learning deep-learning
Language:Python 970
THUDM / P-tuning
A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
few-shot-learning natural-language-processing p-tuning parameter-efficient-learning pre-trained-language-models prompt-tuning
Language:Python 911
OpenBMB / CPM-Live
Live Training for Open-source Big Models
deep-learning multi-task-learning natural-language-generation natural-language-understanding nlp parameter-efficient-learning pretrained-language-model natural-language-processing
Language:Python 510
jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning
A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
computer-vision deep-learning machine-learning multimodal-deep-learning parameter-efficient-learning parameter-efficient-tuning transfer-learning
383
HenryHZY / Awesome-Multimodal-LLM
Research Trends in LLM-guided Multimodal Learning.
llm multimodal large-language-models multimodal-learning in-context-learning instruction-tuning multimodal-large-language-models parameter-efficient-learning parameter-efficient-tuning
343
calpt / awesome-adapter-resources
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
adapters deep-learning natural-language-processing nlp parameter-efficient-learning parameter-efficient-tuning transformers awesome peft
Language:Python 167
k-neural-api
joaopauloschuler / k-neural-api
K-CAI NEURAL API - Keras based neural network API that will allow you to create parameter-efficient, memory-efficient, flops-efficient multipath models with new layer types. There are plenty of examples and documentation.
keras-tensorflow keras-implementations keras-neural-networks keras-models keras-classification-models parameter-efficient parameter-efficient-learning keras-examples keras-layer keras-visualization keras-generators keras-deep-learning keras-image-classifier keras-deep-dream keras-neural-network keras-tutorial keras-image-augmentation keras-tutorials machine-learning-api
Language:Python 133
juyongjiang / CodeUp
CodeUp: A Multilingual Code Generation Llama2 Model with Parameter-Efficient Instruction-Tuning on a Single RTX 3090
code-generation instruction-tuning llama2 multilingual parameter-efficient-learning consumer-hardware
Language:Jupyter Notebook 114
ga642381 / Speech-Prompts-Adapters
This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.
adapter awesome-list papers parameter-efficient-learning prompt reprogramming speech
103
thunlp / Prompt-Transferability
On Transferability of Prompt Tuning for Natural Language Processing
nlp parameter-efficient-learning pretrained-language-model pretrained-language-models pretrained-models prompt prompt-tuning pytorch transfer-learning parameter-efficient-tuning
Language:Python 95
Paranioar / UniPT
[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
cross-modal parameter-efficient-learning parameter-efficient-tuning transfer-learning memory-efficient-learning memory-efficient-tuning parameter-efficient-fine-tuning
Language:Python 61
LeapLabTHU / Cross-Modal-Adapter
[arXiv] Cross-Modal Adapter for Text-Video Retrieval
adapter clip parameter-efficient-tuning video-text-retrieval vision-and-language pytorch deep-learning machine-learning parameter-efficient-learning
51
SALT-NLP / Adaptive-Compositional-Modules
Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"
continual-learning lifelong-learning sequence-generation natural-language-processing adapter parameter-efficient-learning question-answering
Language:Python 38
Srijith-rkr / KAUST-Whisper-Adapter
INTERSPEECH 23 - Refunction Whisper to recognize new tasks with adapters!
automatic-speech-recognition parameter-efficient-learning
Language:Python 32
declare-lab / domadapter
Code for EACL'23 paper "Udapter: Efficient Domain Adaptation Using Adapters"
adapters domain-adaptation parameter-efficient-learning parameter-efficient-tuning
Language:Python 9
cliang1453 / CAMERO
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing (ACL 2022)
consistency-regularization distillation ensemble-learning fine-tuning knowledge-distillation parameter-efficient-learning pretrained-language-model weight-sharing adversarial-perturbations dropouts
Language:Python 7
kEffNetV1
joaopauloschuler / kEffNetV1
This repository contains the source code for the paper "Grouped Pointwise Convolutions Reduce Parameters in Convolutional Neural Networks".
parameter-efficient parameter-efficient-learning parameter-efficient-tuning keras-models keras-cnn keras-deep-learning keras-jupyter-notebook keras-model keras-neural-network keras-tutorials keras-efficientnet keras-mobilenet
Language:Jupyter Notebook 6
Paranioar / SHERL
[ECCV2024] The code of "SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning"
cross-modal memory-efficient-learning memory-efficient-tuning parameter-efficient-fine-tuning parameter-efficient-learning parameter-efficient-tuning transfer-learning
2