jc-hou

VideoMAE

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

fvcore

Collection of common code that's shared among different research projects in FAIR computer vision team.

graph-neural-pde

Graph Neural PDEs

VisualVoice

Audio-Visual Speech Separation with Cross-Modal Consistency

BSSE-SE

Boosting Self-Supervised Embeddings for Speech Enhancement

audio-visual

Transformer-in-Computer-Vision

A paper list of some recent Transformer-based CV works.

av-se

Deep-Learning-Based Audio-Visual Speech Enhancement and Separation

hifi-gan

HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

pytorch-domain-adaptation

A collection of implementations of adversarial domain adaptation algorithms

salad

A toolbox for domain adaptation and semi-supervised learning. Contributions welcome.

MAE-pytorch

Unofficial PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners

code2pdf

Convert your source code to PDF

awesome-tips

UniVL

An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"

VL-T5

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

video-question-answering

Video Question Answering via Gradually Refined Attention over Appearance and Motion

AtSNE

Anchor-t-SNE for large-scale and high-dimension vector visualization

academicpages.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

C2D

PyTorch implementation of "Contrast to Divide: self-supervised pre-training for learning with noisy labels"

pytorch-VideoDataset

Tools for loading video dataset and transforms on video in pytorch. You can directly load video files without preprocessing.

OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

jean-zay-doc

Collaborative documentation for and from Jean Zay users. Official Jean Zay documentation: http://www.idris.fr/eng/jean-zay/

PlotNeuralNet

Latex code for making neural networks diagrams

mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

ZeroShotVideoClassification

Zero-shot video classification by end-to-end training of 3D convolutional neural networks

a-PyTorch-Tutorial-to-Image-Captioning

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

attention-transfer

Improving Convolutional Networks via Attention Transfer (ICLR 2017)