mariaxen

google-research

Google Research

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

tensorboardX

tensorboard for pytorch (and chainer, mxnet, numpy, ...)

adrenaline

Instant answers to any programming question

deepfakes_faceswap

from deekfakes' faceswap: https://www.reddit.com/user/deepfakes/

youtube-8m

Starter code for working with the YouTube-8M dataset.

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

VideoMAE

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

info8010-deep-learning

Lectures for INFO8010 Deep Learning, ULiège

neural_renderer

"Neural 3D Mesh Renderer" (CVPR 2018) by H. Kato, Y. Ushiku, and T. Harada.

CVinW_Readings

A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''

Awesome-CLIP

Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

ast

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

VideoX

VideoX: a collection of video cross-modal models

SPIN

Repository for the paper "Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loop"

UniFormer

[ICLR2022] official implementation of UniFormer

human_body_prior

VPoser: Variational Human Pose Prior

awesome-audio-visual

A curated list of different papers and datasets in various areas of audio-visual processing

Multimodal-Toolkit

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

ActionCLIP

This is the official implement of paper "ActionCLIP: A New Paradigm for Action Recognition"

video_features

Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and TIMM models.

MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

efficient-video-recognition

everything_at_once

This is the official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022

Bridge-Prompt

[CVPR2022] Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos

AVLnet

Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.

RepNet-Pytorch

Temporal repetition counting

avbert

TCAF-GZSL

This repository contains the code for our ECCV 2022 paper "Temporal and cross-modal attention for audio-visual zero-shot learning"

fitclip

Code for the FitCLIP method