choiszt

stitching

A Python package for fast and robust Image Stitching

mv-extractor

Extract frames and motion vectors from H.264 and MPEG-4 encoded video.

LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content

video2game

Code release of Video2Game

lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

TATS

Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)

EgoThink

[CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models"

EgoVideo

[CVPR 2024 Champions] Solutions for EgoVis Chanllenges in CVPR 2024

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

titok-pytorch

Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"

EgoVLP

[NeurIPS2022] Egocentric Video-Language Pretraining

PySceneDetect

:movie_camera: Python and OpenCV-based scene cut/transition detection program & library.

VideoTree

Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"

Video-MME

✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

Interactive-Predicate-Learning

InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning (RSS 2024)

MAP-NEO

LOVA3

The official repo of "Learning to Visual Question Answering, Asking and Assessment"

platonic-rep

VQLoC

(NeurIPS 2023) Open-set visual object query search & localization in long-form videos

self-infilling

[ICML 2024] Self-Infilling Code Generation

CLIPS.jl

Cooperative Language-Guided Inverse Plan Search (CLIPS).

guidance

A guidance language for controlling large language models.

Awesome-LLM4AD

A curated list of awesome LLM for Autonomous Driving resources (continually updated)

AudioMAE

This repo hosts the code and models of "Masked Autoencoders that Listen".

InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

EgocentricVision

🔍 Explore Egocentric Vision: research, data, challenges, real-world apps. Stay updated & contribute to our dynamic repository! Work-in-progress; join us!

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

sglang

SGLang is yet another fast serving framework for large language models and vision language models.

SwiftSage

SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks

FreeVA

FreeVA: Offline MLLM as Training-Free Video Assistant