Haochen-Wang409

VLoRA

[NeurIPS 2024] Visual Perception by Large Language Model’s Weights

Open-O1

LLaVA-NeXT

Lumina-mGPT

Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining"

DIVA

Diffusion Feedback Helps CLIP See Better

flux

Official inference repo for FLUX.1 models

mar

PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Open-MAGVIT2

Open-MAGVIT2: Democratizing Autoregressive Visual Generation

VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks

lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

matryoshka-mm

Matryoshka Multimodal Models

subobjects

Official repository of paper "Subobject-level Image Tokenization"

LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

EVA

EVA Series: Visual Representation Fantasies from BAAI

llama3

The official Meta Llama 3 GitHub site

enhancing-transformers

An unofficial implementation of both ViT-VQGAN and RQ-VAE in Pytorch

VAR

[NeurIPS 2024 Oral][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

DreamLLM

[ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation

SEED

Official implementation of SEED-LLaMA (ICLR 2024).

Semantic-SAM

[ECCV 2024] Official implementation of the paper "Semantic-SAM: Segment and Recognize Anything at Any Granularity"

Maskgit-pytorch

taming-transformers

Taming Transformers for High-Resolution Image Synthesis

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

vector-quantize-pytorch

Vector (and Scalar) Quantization, in Pytorch

DINOv

[CVPR 2024] Official implementation of the paper "Visual In-context Learning"