parameter-efficient-fine-tuning

There are 5 repositories under parameter-efficient-fine-tuning topic.

synbol / Awesome-Parameter-Efficient-Transfer-Learning
Collection of awesome parameter-efficient fine-tuning resources.
awesome-list computer-vision parameter-efficient-fine-tuning transfer-learning survey deep-learning pre-trained-models transformer
395
NVlabs / DoRA
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
commonsense-reasoning deep-learning deep-neural-networks instruction-tuning large-language-models large-vision-language-models lora parameter-efficient-fine-tuning parameter-efficient-tuning vision-and-language
Language:Python 392
Paranioar / Awesome_Matching_Pretraining_Transfering
The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.
cross-modal-retrieval tutorial awesome-list image-text-matching image-text-retrieval large-language-models large-vision-language-models large-vision-models memory-efficient-tuning multimodal-pretraining parameter-efficient-fine-tuning video-text-recognition video-text-retrieval vision-and-language visual-semantic-embedding
365
liuqidong07 / MOELoRA-peft
[SIGIR'24] The official implementation code of MOELoRA.
chatglm large-language-models low-rank-adaptation mixture-of-experts multi-task multitask-learning parameter-efficient-fine-tuning peft peft-fine-tuning-llm
Language:Python 103
ZhengxiangShi / DePT
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
fine-tuning language-model large-language-models natural-language-processing parameter-efficient-tuning peft prompt-tuning parameter-efficient-fine-tuning nlp nlp-machine-learning transfer-learning
Language:Python 87
ziplab / SPT
[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
parameter-efficient-fine-tuning peft adapter lora prompt-tuning transfer-learning
Language:Python 56
architkaila / Fine-Tuning-LLMs-for-Medical-Entity-Extraction
Exploring the potential of fine-tuning Large Language Models (LLMs) like Llama2 and StableLM for medical entity extraction. This project focuses on adapting these models using PEFT, Adapter V2, and LoRA techniques to efficiently and accurately extract drug names and adverse side-effects from pharmaceutical texts
entity-extraction fine-tuning-llm large-language-models medical-application parameter-efficient-fine-tuning
Language:Python 33
umbertocappellazzo / PETL_AST
This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".
adapter audio-processing audio-spectrogram-transformer lora mixture-of-adapters mixture-of-experts parameter-efficient-fine-tuning prompt-tuning transfer-learning
Language:Python 31
iboing / CorDA
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models
catastrophic-forgetting large-language-models parameter-efficient-fine-tuning world-knowledge
Language:Python 23
auniquesun / PPT
[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"
parameter-efficient-fine-tuning parameter-efficient-tuning point-cloud-analysis point-cloud-recognition prompt-learning 3d-point-cloud point-cloud-understanding 3d-shape-part-segmentation 3d-shape-analysis
Language:Jupyter Notebook 15
PurdueDigitalTwin / MACP
[WACV 2024] MACP: Efficient Model Adaptation for Cooperative Perception.
autonomous-vehicles computer-vision cooperative-perception model-adaptation object-tracking parameter-efficient-fine-tuning perception cvf-conference wacv wacv2024
Language:Python 14
alinourian / Fine-tuning-Mistral-7b-QA
Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)
fine-tuning gpt-4 hugging-face large-language-models llm lora low-rank-adaptation mistral-7b multi-turn-dialogue parameter-efficient-fine-tuning peft puffin wandb
Language:Jupyter Notebook 10
Raman1121 / FairTune
A framework to optimize Parameter-Efficient Fine-Tuning for Fairness in Medical Image Analysis
deep-learning fairness-ml medical-image-analysis parameter-efficient-fine-tuning vision-transformer
Language:Python 6
GeorgeVern / lmcor
Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"
data-to-text-generation grammatical-error-correction large-language-models machine-translation parameter-efficient-fine-tuning summarization
Language:Python 4
rochitasundar / Generative-AI-with-Large-Language-Models
This repository contains the lab work for Coursera course on "Generative AI with Large Language Models".
flan-t5 instruction-finetuning kl-divergence large-language-models llm-evaluation low-rank-adaptation parameter-efficient-fine-tuning prompt-engineering proximal-policy-optimization reinforcement-learning reward-model transformer
Language:Jupyter Notebook 4
Andy-LZH / peft4clip
Parameter Efficient Fine-Tuning for CLIP
pytorch parameter-efficient-fine-tuning
Language:Python 3
fork123aniket / LLM-RAG-powered-QA-App
A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App
context-aware-system eleutherai fine-tuning large-language-models llm-inference llm-serving llm-training llmops parameter-efficient-fine-tuning question-answering ray ray-serve retrieval-augmented-generation
Language:Python 2