LaBaZh

followers

following

stars

Lee's starred repositories

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Language:PythonApache-2.01741400

video2dataset

Easily create large video dataset from video urls

Language:PythonMIT47800

VBench

[CVPR2024 Highlight] VBench - We Evaluate Video Generation

Language:PythonApache-2.034100

PLLaVA

Official repository for the paper PLLaVA

Language:Python41700

MAD

MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions

Language:PythonMIT13800

AVE

This is the official repository for our ECCV 2022 paper titled, "The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editing"

Language:Python3900

Awesome-Opus-Long-Video-Understanding

Awesome research works specifically focused on long form videos understanding.

MIT600

movienet-tools

Tools for movie and video research

Language:C++25700

ChatVID

Chat about anything on any video!

Language:PythonMIT3300

DynMoE

[Preprint] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models

Language:PythonApache-2.01800

zju-learning-assistant

帮你快速下载所有课件😋

Language:RustMIT19300

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Language:PythonCC-BY-4.0102100

MM-VID

Open source implementation of the paper "MM-Vid: Advancing Video Understanding with GPT-4V(ision)".

Language:PythonMIT600

MovieChat

[CVPR 2024] 🎬💭 chat with over 10K frames of video!

Language:PythonBSD-3-Clause43500

Awesome-LLMs-for-Video-Understanding

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

VLog

Transform Video as a Document with ChatGPT, CLIP, BLIP2, GRIT, Whisper, LangChain.

Language:PythonMIT50200

trx

Temporal-Relational CrossTransformers (CVPR 2021)

Language:Python10500

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

Language:PythonApache-2.0195800

kinetics-downloader

Download DeepMind's Kinetics dataset.

Language:PythonMIT25800

InternVideo

Video Foundation Models & Data for Multimodal Understanding

Language:PythonApache-2.0104800

all-in-one

[CVPR2023] All in One: Exploring Unified Video-Language Pre-training

Language:Python27400

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

Language:Jupyter NotebookBSD-3-Clause904600

Panda-70M

[CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

Language:Python41500

XPretrain

Multi-modality pre-training

Language:PythonNOASSERTION44800

VideoX

VideoX: a collection of video cross-modal models

Language:PythonNOASSERTION93700

PromptSRC

[ICCV'23 Main Track, WECIA'23 Oral] Official repository of paper titled "Self-regulating Prompts: Foundational Model Adaptation without Forgetting".

Language:PythonMIT19200

CVPR2024-Papers-with-Code

CVPR 2024 论文和开源项目合集

Awesome-Mamba-Collection

A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.

MIT19000

Interview-for-Algorithm-Engineer

【三年面试五年模拟】算法工程师秘籍。AIGC、传统深度学习、自动驾驶、机器学习、计算机视觉、自然语言处理、图像处理、元宇宙、SLAM等AI行业面试笔试经验分享

GPL-3.018700

PhotoMaker

PhotoMaker

Language:Jupyter NotebookNOASSERTION852900