chuangg

CLEVRER

PyTorch implementation of ICLR 2020 paper "CLEVRER: CoLlision Events for Video REpresentation and Reasoning"

Foley-Music

PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "

tdw-transport-challenge-starter-code

find_fallen_objects

Official implementation of CVPR 2022 paper "Finding Fallen Objects Via Asynchronous Audio-Visual Integration".

OPEn

tdw-transport-challenge

GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

imageqa-san

code for Stacked attention networks for image question answering

rnn

Recurrent Neural Network library for Torch7's nn

SCN_for_video_captioning

Using Semantic Compositional Networks for Video Captioning

Semantic_Compositional_Nets

The Theano code for the CVPR 2017 paper "Semantic Compositional Networks for Visual Captioning"

SfMLearner

An unsupervised learning framework for depth and ego-motion estimation from monocular videos

stylenet-1

A pytorch implemention of "StyleNet: Generating Attractive Visual Captions with Styles"

TensorFlow-Tutorials

Simple tutorials using Google's TensorFlow Framework

tvnet

End-to-End Learning of Motion Representation for Video Understanding

Youtube-8M

PaddlePaddle models for Youtube-8M Video Understanding Challenge

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.

StyleNet

vqs

VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation