felixfuu

Track-Anything

Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.

RPG-DiffusionMaster

[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (PRG)

NExT-Chat

The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".

unified-io-2

LLaVA-Grounding

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

LLaMA2-Accessory

An Open-source Toolkit for LLM Development

MQ-Det

Official PyTorch implementation of "Multi-modal Queried Object Detection in the Wild" (accepted by NeurIPS 2023)

GLEE

[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale

FIND

VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models

AnyDoor

Official implementations for paper: Anydoor: zero-shot object-level image customization

awesome-diffusion-categorized

collection of diffusion model papers categorized by their subareas

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

HumanBench

This repo is official implementation of HumanBench (CVPR2023)

BLIText

[NeurIPS 2023] Bootstrapping Vision-Language Learning with Decoupled Language Pre-training

LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

consistencydecoder

Consistency Distilled Diff VAE

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

Entity

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

ALIKE

ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extraction

T2I-Adapter

T2I-Adapter

COMM

Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models

Mini-DALLE3

Mini-DALLE3: Interactive Text to Image by Prompting Large Language Models

MiniGPT-5

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

awesome-LLMs-In-China

**大模型

stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Cheetah