yanwei-li

grok-1

Grok open release

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

llama3

The official Meta Llama 3 GitHub site

mistral-inference

Official inference library for Mistral models

ImageBind

ImageBind One Embedding Space to Bind Them All

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

NExT-GPT

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

LVM

Vary

Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.

LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

Emu

Emu Series: Generative Multimodal Models from BAAI

lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

EdgeSAM

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"

LLaVA-NeXT

DriveLM

DriveLM: Driving with Graph Visual Question Answering

LLaMA-VID

Official Implementation for LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models

Woodpecker

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.

APE

[CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception

LLMGA

This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant'

LLaVA-RLHF

Aligning LMMs with Factually Augmented RLHF

ALLaVA

Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model

RIVAL

[NeurIPS 2023 Spotlight] Real-World Image Variation by Aligning Diffusion Inversion Chain

coconut_cvpr2024

Prompt-Highlighter

[CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs

X-Ray

The official source code for "X-Ray: A Sequential 3D Representation for Generation".