BradyFU

EAGLE

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

MME-RealWorld

✨✨ MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?

VITA

✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM

RWKU

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024

SliME

✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models

Awesome-Open-Vocabulary-Detection-and-Segmentation

Awesome OVD-OVS - A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future

Libra

Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)

Video-MME

✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

VEGA

conv-llava

cantor

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

VMamba

VMamba: Visual State Space Models，code is based on mamba

APE

[CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception

LLaMA-VID

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering

GaussianDreamer

GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models (CVPR 2024)

Lion

Lion: Kindling Vision Intelligence within Large Language Models

FF3D

CNeRF

Pytorch implementation of AAAI2023 Oral paper "Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field"

MUST-GAN

Pytorch implementation of CVPR2021 paper "MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generation"

MUTR

[AAAI 2024] Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation

PanoVOS

[ECCV 2024] PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentation

Woodpecker

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.

LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

MQ-Det

Official PyTorch implementation of "Multi-modal Queried Object Detection in the Wild" (accepted by NeurIPS 2023)

vision-process-webui

💡💡💡awesome compute vision app in gradio

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

SeqTR

SeqTR: A Simple yet Universal Network for Visual Grounding

TiNeuVox

TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels (SIGGRAPH Asia 2022)