Jie Lei 雷杰's repositories
moment_detr
[NeurIPS 2021] Moment-DETR code and QVHighlights dataset
recurrent-transformer
[ACL 2020] PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning
TVRetrieval
[ECCV 2020] PyTorch code for XML on TVRetrieval dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval
singularity
[ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
VideoLanguageFuturePred
[EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction
mTVRetrieval
[ACL 2021] mTVR: Multilingual Video Moment Retrieval
pytorch-pretrained-BERT
A copy from https://github.com/huggingface/pytorch-pretrained-BERT
video_feature_extractor
Easy to use video deep features extractor
accelerate
A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
coot-videotext
COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning
info-ground
Learning phrase grounding from captioned images through InfoNCE bound on mutual information
just-ask
[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
mmaction2-1
OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
Oscar
Oscar and VinVL
releasing-research-code
Tips for releasing research code in Machine Learning (with official NeurIPS 2020 recommendations)
YouCook2-Leaderboard
A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.