LBH1024

lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

Show-o

Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

Chat-UniVi

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Video-LLaVA

【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

LLaVA-NeXT

NExT-GPT

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

Qwen2.5-Math

A series of math-specific large language models of our Qwen2 series.

InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

LanguageBind

【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

Kolors

Kolors Team

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

llama3

The official Meta Llama 3 GitHub site

DeepSpeedExamples

Example models using DeepSpeed

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

Classic-Generative-Model

Simple code demos about classic AIGC models/Compilation of blogs and papers on classic AIGC models.

LeanEuclid

LeanEuclid is a benchmark for autoformalization in the domain of Euclidean geometry, targeting the proof assistant Lean.

MP5

[CVPR2024] This is the official implement of MP5

MathVista

MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts

MathVerse

[ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

InternLM-Math

State-of-the-art bilingual open-sourced Math reasoning LLMs.

alphageometry

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

DeepSeek-Math

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models