nth2000

AgentBoard

An Analytical Evaluation Board of Multi-turn LLM Agents

ChartMimic

ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation

LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型

TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

Awesome-Chart-Understanding

A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.

OneBit

The homepage of OneBit model quantization framework.

GraphGPT

[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"

Awesome-TableReasoning-LLM-Survey

T2I-CompBench

[Neurips 2023] T2I-CompBench: A Comprehensive Benchmark for Open-world Compositional Text-to-image Generation

opencv

Open Source Computer Vision Library

Linguistic-Binding-in-Diffusion-Models

Attend-and-Excite

Official Implementation for "Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models" (SIGGRAPH 2023)

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.

MiniGPT-5

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

HallusionBench

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

huozi

活字通用大模型

text2image-benchmark

Benchmark for generative image models

Chinese-Mixtral-8x7B

中文Mixtral-8x7B（Chinese-Mixtral-8x7B）

pi-Tuning

Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.

LLaMA-Pro

[ACL 2024] Progressive LLaMA with Block Expansion.

magicoder

Magicoder: Source Code Is All You Need

label-words-are-anchors

Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning

blended-diffusion

Official implementation for "Blended Diffusion for Text-driven Editing of Natural Images" [CVPR 2022]

Awesome-LLM-hallucination

LLM hallucination paper list

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

GVT

Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".

stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content

SEED

Official implementation of SEED-LLaMA (ICLR 2024).