Jie Lei 雷杰 (jayleicn)

jayleicn

Geek Repo

Company:Meta AI

Location:Seattle

Home Page:https://jayleicn.github.io/

Twitter:@jayleicn

Github PK Tool:Github PK Tool

Jie Lei 雷杰's repositories

animeGAN

A simple PyTorch Implementation of Generative Adversarial Networks, focusing on anime face drawing.

Language:Jupyter NotebookLicense:MITStargazers:1276Issues:44Issues:9

ClipBERT

[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.

Language:PythonLicense:MITStargazers:685Issues:9Issues:58

moment_detr

[NeurIPS 2021] Moment-DETR code and QVHighlights dataset

Language:PythonLicense:MITStargazers:228Issues:11Issues:52

recurrent-transformer

[ACL 2020] PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning

Language:Jupyter NotebookLicense:MITStargazers:168Issues:10Issues:11

TVQA

[EMNLP 2018] PyTorch code for TVQA: Localized, Compositional Video Question Answering

Language:PythonLicense:MITStargazers:157Issues:10Issues:17

TVRetrieval

[ECCV 2020] PyTorch code for XML on TVRetrieval dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval

Language:PythonLicense:MITStargazers:147Issues:8Issues:12

singularity

[ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"

Language:PythonLicense:MITStargazers:122Issues:2Issues:30

TVQAplus

[ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering

Language:PythonLicense:MITStargazers:120Issues:11Issues:23

TVCaption

[ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset

Language:PythonLicense:MITStargazers:82Issues:7Issues:2

VideoLanguageFuturePred

[EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction

mTVRetrieval

[ACL 2021] mTVR: Multilingual Video Moment Retrieval

pytorch-pretrained-BERT

A copy from https://github.com/huggingface/pytorch-pretrained-BERT

Language:Jupyter NotebookLicense:Apache-2.0Stargazers:1Issues:3Issues:0

video_feature_extractor

Easy to use video deep features extractor

Language:PythonLicense:Apache-2.0Stargazers:1Issues:1Issues:0

2D-TAN

AAAI‘20 - Learning 2D Temporal Localization Networks for Moment Localization with Natural Language

Language:PythonLicense:NOASSERTIONStargazers:0Issues:1Issues:0

accelerate

A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

Language:PythonLicense:Apache-2.0Stargazers:0Issues:1Issues:0

ALPRO

Align and Prompt: Video-and-Language Pre-training with Entity Prompts

Language:PythonLicense:BSD-3-ClauseStargazers:0Issues:1Issues:0

CLIP

Contrastive Language-Image Pretraining

Language:Jupyter NotebookLicense:MITStargazers:0Issues:1Issues:0

coot-videotext

COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning

Language:PythonLicense:Apache-2.0Stargazers:0Issues:1Issues:0

detr

End-to-End Object Detection with Transformers

Language:PythonLicense:Apache-2.0Stargazers:0Issues:1Issues:0

easyturk

Make quick mechanical turk HTML/Javascript interfaces and launch them with Python functions

Language:HTMLLicense:NOASSERTIONStargazers:0Issues:1Issues:0

HERO-1

Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"

Language:PythonLicense:MITStargazers:0Issues:1Issues:0

info-ground

Learning phrase grounding from captioned images through InfoNCE bound on mutual information

Language:PythonLicense:NOASSERTIONStargazers:0Issues:1Issues:0

just-ask

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

Language:Jupyter NotebookLicense:Apache-2.0Stargazers:0Issues:0Issues:0

mmaction2-1

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

Language:PythonLicense:Apache-2.0Stargazers:0Issues:1Issues:0

mmf-1

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Language:PythonLicense:NOASSERTIONStargazers:0Issues:1Issues:0

Oscar

Oscar and VinVL

License:MITStargazers:0Issues:0Issues:0

releasing-research-code

Tips for releasing research code in Machine Learning (with official NeurIPS 2020 recommendations)

License:MITStargazers:0Issues:1Issues:0

SlowFast

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

Language:PythonLicense:Apache-2.0Stargazers:0Issues:1Issues:0

UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

Language:PythonStargazers:0Issues:1Issues:0

YouCook2-Leaderboard

A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.

Stargazers:0Issues:0Issues:0