visual-prompting

There are 2 repositories under visual-prompting topic.

roboflow / multimodal-maestro
Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥
lmm multimodality segment-anything instance-segmentation object-detection gpt-4 gpt-4-vision llava prompt-engineering visual-prompting cross-modal vision-language-model
Language:Python 959
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 245
ZhangYuanhan-AI / NOAH
Searching prompt modules for parameter-efficient transfer learning.
deep-learning domain-generalization pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 205
WisconsinAIVision / ViP-LLaVA
[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
chatbot clip foundation-models gpt-4 gpt-4-vision llama llama2 llava multi-modal vision-language visual-prompting cvpr2024
Language:Python 169
JieShibo / PETL-ViT
[ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
parameter-efficient-tuning pytorch transfer-learning visual-prompting
Language:Python 161
ZhangYuanhan-AI / visual_prompt_retrieval
[NeurIPS2023] Official implementation and model release of the paper "What Makes Good Examples for Visual In-Context Learning?"
in-context-learning prompt visual-prompting
Language:Python 156
changdaeoh / BlackVIP
Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
black-box-optimization foundation-models parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting
Language:Python 98
WisconsinAIVision / visii
👀 Visual Instruction Inversion: Image Editing via Visual Prompting (NeurIPS 2023)
diffusion-models image-editing visual-prompting image-manipulation neurips neurips-2023
Language:Python 72
bighuang624 / VoP
[CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval
parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting cvpr2023
31
IBM / AutoVP
[ICLR24] AutoVP: An Automated Visual Prompting Framework and Benchmark
downstream-tasks efficient-inference finetuning ood-robustness reprogramming visual-prompt visual-prompting foundation-models low-data-regime model-agnostic
Language:Python 14
landskape-ai / Reprogram_LT
[arXiv] "Uncovering the Hidden Cost of Model Compression" by Diganta Misra, Agam Goyal, Bharat Runwal, and Pin-Yu Chen
adversarial-reprograming calibration linear-probing lottery-ticket-hypothesis lottery-tickets pruning sparsity transfer-learning visual-prompting
Language:Python 7
MSchnei / visprompt
A simple GUI for experimenting with visual prompting
sam seggpt segmentation visual-prompting
Language:Python 2