vision-language-learning

There are 0 repository under vision-language-learning topic.

AIDC-AI / Ovis
A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
chatbot llama3 multimodal multimodal-large-language-models multimodality qwen vision-language-learning vision-language-model
Language:Python 584
shikiw / OPERA
[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation
large-multimodal-models llama multimodal vision-language-learning vision-language-model chatbot chatgpt gpt-4
Language:Python 296
RLHF-V / RLAIF-V
RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness
chatbot gpt-4v llava llava-next minicpm-v multimodal rlaif-v vision-language-learning
Language:Python 260
shikiw / Modality-Integration-Rate
The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".
chatbot gpt-4o large-multimodal-models llama llava multimodal vision-language-learning vision-language-model
Language:Python 89
YunzeMan / Situation3D
[CVPR 2024] Situational Awareness Matters in 3D Vision Language Reasoning
3d-scene-understanding deep-learning multi-modal-learning multimodal-learning vision-language-learning vision-language-model
Language:Python 29
LooperXX / ManagerTower
Code for ACL 2023 Oral Paper: ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
multi-modal-learning vision-language vision-language-learning vision-language-pretraining
Language:Python 11
SHTUPLUS / GITM-MR
The official implementation for the ICCV 2023 paper "Grounded Image Text Matching with Mismatched Relation Reasoning".
vision-and-language vision-language-model vision-and-language-pre-training vision-language-dataset vision-language-learning
Language:Python 6
yubin1219 / CrossVLT
Cross-aware Early Fusion with Stage-divided Vision and Language Transformer Encoders for Referring Image Segmentation (Published in IEEE TMM 2023)
pytorch referring-image-segmentation vision-language-learning
Language:Python 5
lyuchenyang / Dialogue-to-Video-Retrieval
Code for ECIR 2023 paper "Dialogue-to-Video Retrieval"
deep-learning machine-learning multimedia neural-networks video-retrieval vision-language-learning
Language:Python 3
abhinav-neil / socratic-models
Socratic models for multimodal reasoning & image captioning
chain-of-thought clip flan-t5 gpt-3 image-captioning multimodal-learning vision-language-learning visual-question-answering
Language:Jupyter Notebook 1
Ravi-Teja-konda / TunedLlavaDelights
Explore the rich flavors of Indian desserts with TunedLlavaDelights. Utilizing the in Llava fine-tuning, our project unveils detailed nutritional profiles, taste notes, and optimal consumption times for beloved sweets. Dive into a fusion of AI innovation and culinary tradition
chatgpt dalle2 dessert finetuning gpt4 gpt4v llama2 llava multi-modality multimodal nutrition nutrition-information stable-diffusion tranformers vision-language-learning vision-language-model
Language:Python 1

vision-language-learning

AIDC-AI / Ovis

shikiw / OPERA

RLHF-V / RLAIF-V

shikiw / Modality-Integration-Rate

YunzeMan / Situation3D

LooperXX / ManagerTower

SHTUPLUS / GITM-MR

yubin1219 / CrossVLT

lyuchenyang / Dialogue-to-Video-Retrieval

abhinav-neil / socratic-models

Ravi-Teja-konda / TunedLlavaDelights