ycsun1972

Video-MME

✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

ScientificEvolution

Awesome-Video-Diffusion

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

Awesome-LLMs-for-Video-Understanding

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

ml-ferret

Awesome-Video-Datasets

Video datasets

Visual-Instruction-Tuning

SVIT: Scaling up Visual Instruction Tuning

shikra

ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

Valley

The official repository of "Video assistant towards large language model makes everything easy"

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

VisionLLM

VisionLLM Series

esper

ESPER

TestOfTime

Official code for our CVPR 2023 paper: Test of Time: Instilling Video-Language Models with a Sense of Time

LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

Text2Poster-ICASSP-22

Official implementation of the ICASSP-2022 paper "Text2Poster: Laying Out Stylized Texts on Retrieved Images"

FrozenBiLM

[NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

MMTG

[ACM MM 2022]: Multi-Modal Experience Inspired AI Creation

awesome-multimodal-dialogue

Paper, dataset and code list for multimodal dialogue.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

language-guided-animation

Language-Guided Face Animation by Recurrent StyleGAN-based Generator

Awesome-Computer-Vision-Paper-List

This repository contains all the papers accepted in top conference of computer vision, with convenience to search related papers.

TextBox

TextBox 2.0 is a text generation library with pre-trained language models

awesome-audiovisual-learning

A curated list of audio-visual learning methods and datasets.

XPretrain

Multi-modality pre-training

awesome-embodied-vision

Reading list for research topics in embodied vision

CVPR2024-Paper-Code-Interpretation

cvpr2024/cvpr2023/cvpr2022/cvpr2021/cvpr2020/cvpr2019/cvpr2018/cvpr2017 论文/代码/解读/直播合集，极市团队整理

Transformer-in-Vision

Recent Transformer-based CV and related works.