Artanic30

MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

ALLaVA

Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model

DivideMix

Code for paper: DivideMix: Learning with Noisy Labels as Semi-supervised Learning

MacCap

AAAI 2024 Accepted Paper Mining Fine-Grained Image-Text Alignment for Zero-Shot Captioning via Text-Only Training

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

NaviLLM

[CVPR 2024] The code for paper 'Towards Learning a Generalist Model for Embodied Navigation'

Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

DiT-3D

🔥🔥🔥Official Codebase of "DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation"

InstructDet

Retrieval-Augmented-Visual-Question-Answering

This is the official repository for Retrieval Augmented Visual Question Answering

Long-CLIP

[ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"

ManipVQA

[IROS24 Oral]ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models

VL-CheckList

Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations.

all-seeing

[ICLR 2024] This is the official implementation of the paper "The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World"

SiT

Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"

mamba

Mamba SSM architecture

aliyunpan

阿里云盘命令行客户端，支持JavaScript插件，支持同步备份功能。

groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

COLA

COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!

BenchLMM

BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Models

MobileVLM

Strong and Open Vision Language Assistant for Mobile Devices

SGVL

vision-language-models-are-bows

Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR 2023

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Maskgit-pytorch

SEED

Official implementation of SEED-LLaMA (ICLR 2024).

CoVLM

Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding

taming-transformers

Taming Transformers for High-Resolution Image Synthesis