Yui010206

SeViLA

[NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering

CREMA

☕️ CREMA: Multimodal Compositional Video Reasoning via Efficient Modular Adaptation and Fusion

MoPRL

[TCSVT] Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detection

AIART_Website

an image style translatiton website

AlphaPose

Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System

arunmallya.github.io

my public website

awesome-anomaly-detection

A curated list of awesome anomaly detection resources

awesome-vln

A curated list of research papers in Vision-Language Navigation (VLN)

detectron2

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

grid-feats-vqa

Grid features pre-training code for visual question answering

HOI-Learning-List

A list of Human-Object Interaction Learning.

just-ask

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

MAC

magenta

Magenta: Music and Art Generation with Machine Intelligence

merlot_reserve

Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"

mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

n2nmn

Code release for Hu et al. Learning to Reason: End-to-End Module Networks for Visual Question Answering. in ICCV, 2017

Person-Search-with-Natural-Language-Description

Person Search with Natural Language Description

Research

novel deep learning research works with PaddlePaddle

Scene-Graph-Benchmark.pytorch

A new codebase for popular Scene Graph Generation methods (2020). Visualization & Scene Graph Extraction on custom images/datasets are provided. It's also a PyTorch implementation of paper “Unbiased Scene Graph Generation from Biased Training CVPR 2020”

seg2vid

Video Generation from Single Semantic Label Map

SJTUThesis

Shanghai Jiao Tong University XeLaTeX Thesis Template

SlowFast

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

transformer-time-series-prediction

proof of concept for a transformer-based time series prediction model

VGT

Video Graph Transformer for Video Question Answering (ECCV'22)

video-swin-transformer-pytorch

Video Swin Transformer - PyTorch

video_feature_extractor

Easy to use video deep features extractor

ViLT

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

Yui010206.github.io