visual-prompting

There are 1 repository under visual-prompting topic.

roboflow / multimodal-maestro
Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥
cross-modal gpt-4 gpt-4-vision instance-segmentation llava lmm multimodality object-detection prompt-engineering segment-anything vision-language-model visual-prompting
Language:Python 940
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch visual-prompting transfer-learning
Language:Python 242
ZhangYuanhan-AI / NOAH
Searching prompt modules for parameter-efficient transfer learning.
prompt-tuning transfer-learning domain-generalization visual-prompting pre-trained-model pytorch deep-learning
Language:Python 202
JieShibo / PETL-ViT
Official code of [ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
parameter-efficient-tuning pytorch transfer-learning visual-prompting
Language:Python 157
ZhangYuanhan-AI / visual_prompt_retrieval
[NeurIPS2023] Official implementation and model release of the paper "What Makes Good Examples for Visual In-Context Learning?"
in-context-learning prompt visual-prompting
Language:Python 155
mu-cai / ViP-LLaVA
[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
chatbot clip foundation-models gpt-4 gpt-4-vision llama llama2 llava multi-modal vision-language visual-prompting cvpr2024
Language:Python 148
changdaeoh / BlackVIP
Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
black-box-optimization foundation-models parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting
Language:Python 95
thaoshibe / visii
👀 Visual Instruction Inversion: Image Editing via Visual Prompting (NeurIPS 2023)
diffusion-models image-editing visual-prompting image-manipulation neurips neurips-2023
Language:Python 71
bighuang624 / VoP
[CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval
cvpr2023 parameter-efficient-tuning prompt-tuning transfer-learning visual-prompting
31
IBM / AutoVP
[ICLR24] AutoVP: An Automated Visual Prompting Framework and Benchmark
downstream-tasks efficient-inference finetuning ood-robustness reprogramming visual-prompt visual-prompting foundation-models low-data-regime model-agnostic
Language:Python 13
landskape-ai / Reprogram_LT
[arXiv] "Uncovering the Hidden Cost of Model Compression" by Diganta Misra, Agam Goyal, Bharat Runwal, and Pin-Yu Chen
adversarial-reprograming calibration linear-probing lottery-ticket-hypothesis lottery-tickets sparsity transfer-learning visual-prompting pruning
Language:Python 7