forrestsz

ThirdToFirst

clip_it

CLIP-It! Language-Guided Video Summarization

charades-algorithms

Activity Recognition Algorithms for the Charades Dataset

actor-observer

ActorObserverNet code in PyTorch from "Actor and Observer: Joint Modeling of First and Third-Person Videos", CVPR 2018

forecasting

AVT

Code release for ICCV 2021 paper "Anticipative Video Transformer"

all-in-one

[CVPR2023] All in One: Exploring Unified Video-Language Pre-training

webui-aria2

The aim for this project is to create the worlds best and hottest interface to interact with aria2. Very simple to use, just download and open index.html in any web browser.

CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

Awesome-Mixture-of-Experts-Papers

A curated reading list of research in Mixture-of-Experts(MoE).

Efficient-Prompt

episodic-memory

Efficient-PyTorch

My best practice of training large dataset using PyTorch.

Ego4d

Ego4d dataset repository. Download the dataset, visualize, extract features & example usage of the dataset

howto100m

Code for the HowTo100M paper

HERO_Video_Feature_Extractor

Video Feature Extraction Code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"

video_features

Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and TIMM models.

epic-kitchens-slowfast

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

evit

Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations

slowfast_feature_extractor

Feature Extractor module for videos using the PySlowFast framework

Balanced-DataParallel

这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量

VideoX

VideoX: a collection of video cross-modal models

Ego-Exo

Code accompanying Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos (CVPR 2021)

video_feature_extractor

Easy to use video deep features extractor

YouCook2-Leaderboard

A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.

epic-kitchens-download-scripts

Download scripts for EPIC-KITCHENS

ProcNets-YouCook2

Source code for paper "Towards Automatic Learning of Procedures from Web Instructional Videos"

20bn-something-something-label-hierarchies

Metadata for the Something-Something dataset

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch