pengzhansun

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

gaussian-splatting

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

dino

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO

GroundingDINO

[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

sort

Simple, online, and realtime tracking of multiple objects in a video sequence.

Moore-AnimateAnyone

Character Animation (AnimateAnyone, Face Reenactment)

co-tracker

CoTracker is a model for tracking any point (pixel) on a video.

Multimodal-GPT

Multimodal-GPT

CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

shikra

Grounding-DINO-1.5-API

API for Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series

ChatCaptioner

Official Repository of ChatCaptioner

Pandora

Pandora: Towards General World Model with Natural Language Actions and Video States

Uni3D

[ICLR'24 Spotlight] Uni3D: 3D Visual Representation from BAAI

unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

paco

This repo contains documentation and code needed to use PACO dataset: data loaders and training and evaluation scripts for objects, parts, and attributes prediction models, query evaluation scripts, and visualization notebooks.

EgoVLP

[NeurIPS2022] Egocentric Video-Language Pretraining

InternVideo2

IART

[CVPR 2024 Highlight] Enhancing Video Super-Resolution via Implicit Resampling-based Alignment.

VindLU

EgoVLPv2

Code release for "EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone" [ICCV, 2023]

attention-interpolation-diffusion

Interpolation Between Text-to-Image Generation!

vrb

InstructHumans

Editing Animated 3D Human Textures with Instructions

hoi-forecast

[CVPR 2022] Joint hand motion and interaction hotspots prediction from egocentric videos

MRFA

[NeurIPS 2023] Learning Motion Refinement for Unsupervised Face Animation

IVG

This repo holds the official code and data for "Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentions", which is accepted by ACL 2024 (Findings).

RIO

SR-Track

DAIR