visual-prompting

There are 3 repositories under visual-prompting topic.

roboflow / multimodal-maestro
streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL
captioning fine-tuning florence-2 multimodal objectdetection paligemma phi-3-vision transformers vision-and-language vqa
Language:Python 1308
WisconsinAIVision / ViP-LLaVA
[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
chatbot clip cvpr2024 foundation-models gpt-4 gpt-4-vision llama llama2 llava multi-modal vision-language visual-prompting
Language:Python 283
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 260
ZhangYuanhan-AI / NOAH
[TPAMI] Searching prompt modules for parameter-efficient transfer learning.
deep-learning domain-generalization pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 219
JieShibo / PETL-ViT
[ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass
pytorch transfer-learning visual-prompting parameter-efficient-tuning
Language:Python 168
ZhangYuanhan-AI / visual_prompt_retrieval
[NeurIPS2023] Official implementation and model release of the paper "What Makes Good Examples for Visual In-Context Learning?"
in-context-learning prompt visual-prompting
Language:Python 161
changdaeoh / BlackVIP
Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
black-box-optimization foundation-models parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting
Language:Python 102
WisconsinAIVision / visii
👀 Visual Instruction Inversion: Image Editing via Visual Prompting (NeurIPS 2023)
diffusion-models image-editing visual-prompting image-manipulation neurips neurips-2023
Language:Python 83
bighuang624 / VoP
[CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval
cvpr2023 parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting
36
IBM / AutoVP
[ICLR24] AutoVP: An Automated Visual Prompting Framework and Benchmark
downstream-tasks efficient-inference finetuning ood-robustness reprogramming visual-prompt visual-prompting foundation-models low-data-regime model-agnostic
Language:Python 16
JinhaoLee / WCA
[ICML 2024] Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models
vision-language-model deep-learning image-text-matching large-language-models similarity-score visual-prompting zero-shot-classification visual-text-alignment textual-prompting
Language:Python 11
landskape-ai / Reprogram_LT
[arXiv] "Uncovering the Hidden Cost of Model Compression" by Diganta Misra, Agam Goyal, Bharat Runwal, and Pin-Yu Chen
adversarial-reprograming calibration linear-probing lottery-ticket-hypothesis lottery-tickets sparsity transfer-learning visual-prompting pruning
Language:Python 7
MSchnei / visprompt
A simple GUI for experimenting with visual prompting
sam seggpt segmentation visual-prompting
Language:Python 2
afondiel / Prompt-Engineering-for-Vision-Models-DeepLearningAI
These notes and resources are compiled from the crash course Prompt Engineering for Vision Models offered by DeepLearning.AI.
diffusion-models meta-sam prompt-engineering vision-models visual-prompting vit vision-model-prompting cnn convnets large-vision-language-models large-vision-models vision-language-model image-processing video-processing
Language:Jupyter Notebook 1