xdeng7

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

PixelLM

PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding. PixelLM is accepted by CVPR 2024.

flux

Official inference repo for FLUX.1 models

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

SimpleTuner

A general fine-tuning kit geared toward diffusion models.

CAPTURE

Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.

richhf-18k

RichHF-18K dataset contains rich human feedback labels we collected for our CVPR'24 paper: https://arxiv.org/pdf/2312.10240, along with the file name of the associated labeled images (no urls or images are included in this dataset).

BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

LLaVA-NeXT

DenseDiffusion

Official Pytorch Implementation of DenseDiffusion (ICCV 2023)

Omost

Your image is almost there!

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

coconut_cvpr2024

NightLab

LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

ViTamin

[CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"

champ

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

sam-hq

Segment Anything in High Quality [NeurIPS 2023]

InstanceDiffusion

[CVPR 2024] Code release for "InstanceDiffusion: Instance-level Control for Image Generation"

groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

ImageReward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation

motion_guidance

Code for ICLR 2024 paper "Motion Guidance: Diffusion-Based Image Editing with Differentiable Motion Estimators"