isrkhou

cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

CogVLM2

GPT4V-level open-source multi-modal model based on Llama3-8B

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

DeepSeek-VL

DeepSeek-VL: Towards Real-World Vision-Language Understanding

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型

VLM_survey

Collection of AWESOME vision-language models for vision tasks

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

SoM

Set-of-Mark Prompting for LMMs

SoM-LLaVA

[COLM-2024] List Items One by One: Empowering Multimodal LLMs with Set-of-Mark Prompting and Improved Visual Reasoning Ability.

Video-LLaVA

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

UMT

🎬 UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection (CVPR 2022)

guidance-based-video-grounding

[ICCV 2023] The official PyTorch implementation of the paper: "Localizing Moments in Long Video Via Multimodal Guidance"

HiREST

Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)

CGDETR

Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Grounding"

QD-DETR

Official pytorch repository for "QD-DETR : Query-Dependent Video Representation for Moment Retrieval and Highlight Detection" (CVPR 2023 Paper)

DINOv

[CVPR 2024] Official implementation of the paper "Visual In-context Learning"

omnimotion

T-Rex

[ECCV2024] API code for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

MQ-Det

Official PyTorch implementation of "Multi-modal Queried Object Detection in the Wild" (accepted by NeurIPS 2023)

YOLO-World

[CVPR 2024] Real-Time Open-Vocabulary Object Detection

supervision

We write your reusable computer vision tools. 💜

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

InternGPT

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

InstantID

InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥

devit

yolov9

Implementation of paper - YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information

flair

A very simple framework for state-of-the-art Natural Language Processing (NLP)