VoyageWang

Paints-UNDO

Understand Human Behavior to Align True Needs

F-LMM

Code Release of F-LMM: Grounding Frozen Large Multimodal Models

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

STIC

Enhancing Large Vision Language Models with Self-Training on Image Comprehension.

PhraseCutDataset

Dataset API for "PhraseCut: Language-based Image Segmentation in the Wild"

shikra

InstructBLIP_PEFT

MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

fastcomposer

FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

bubogpt

BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs

imageinwords

Data release for the ImageInWords (IIW) paper.

pykan

Kolmogorov Arnold Networks

UESTC-Glasgow-Final-Year-Report-Template

电子科大格院毕设LaTeX模板

Segment-Everything-Everywhere-All-At-Once

[NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Caption-Anything

Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything

NExT-Chat

The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".

pyreft

ReFT: Representation Finetuning for Language Models

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

Prompt-Highlighter

[CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

LOGO

Accepted by CVPR 2023

NAE_CVPR2024

Accepted by CVPR 2024

UniVS

Code release for "UniVS: Unified and Universal Video Segmentation with Prompts as Queries" (CVPR2024)

DCI

Densely Captioned Images (DCI) dataset repository.

RSMamba

This is the pytorch implement of the paper "RSMamba: Remote Sensing Image Classification with State Space Model"

attention-map

🚀 Cross attention map tools for huggingface/diffusers