video-representation-learning

There are 2 repositories under video-representation-learning topic.

MCG-NJU / VideoMAE
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
self-supervised-learning action-recognition video-understanding masked-autoencoder transformer vision-transformer video-transformer mae pytorch video-representation-learning video-analysis neurips-2022
Language:Python 1240
cvlab-columbia / hyperfuture
Code for the paper Learning the Predictability of the Future (CVPR 2021)
hyperbolic-embeddings self-supervised-learning uncertainty-modeling video-representation-learning future-predi
Language:Python 158
xyzforever / BEVT
PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
action-recognition bert deep-learning masked-autoencoder pytorch video-understanding foundation-models self-supervised-learning video-representation-learning
Language:Python 151
ruiwang2021 / mvd
[CVPR2023] Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning (https://arxiv.org/abs/2212.04500)
action-recognition masked-autoencoder self-supervised-learning video-representation-learning video-understanding vision-transformer cvpr2023
Language:Python 92
ttengwang / Awesome_Long_Form_Video_Understanding
Awesome papers & datasets specifically focused on long-term videos.
audio-visual-event-localization dense-video-captioning temporal-action-detection temporal-action-localization temporal-sentence-grounding video-dataset video-grounding video-representation-learning long-term-video video-large-language-models video-llms
92
GV1028 / videogan
Implementation of "Generating Videos with Scene Dynamics" in Tensorflow
generative-adversarial-network tensorflow video video-generation video-representation-learning
Language:Python 76
boschresearch / rince
This is the code accompanying the AAAI 2022 paper "Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives" https://arxiv.org/abs/2201.11736 . The method allows you to use additional ranking information for representation learning.
classification contrastive-learning out-of-distribution-detection representation-learning self-supervised-learning video-representation-learning
Language:Python 24
xiaojieli0903 / MaskAgain
Official repository of the “Mask Again: Masked Knowledge Distillation for Masked Video Modeling” (ACM MM 2023)
knowledge-distillation masked-video-modeling video-representation-learning
Language:Python 20
sunilhoho / VideoMS
Official Pytorch implementation of Efficient Video Representation Learning via Masked Video Modeling with Motion-centric Token Selection.
video-representation-learning self-supervised-learning video-learning masked-autoencoder representation-learning
Language:Python 18
MSQNet
mondalanindya / MSQNet
Actor-agnostic Multi-label Action Recognition with Multi-modal Query [ICCVW '23]
action-recognition animal-behavior charades hmdb51 video-representation-learning vision-and-language vision-language vision-transformer zero-shot-classification
Language:Python 16
xiaojieli0903 / FGKVMemPred_video
Official repository of the "Fine-grained Key-Value Memory Enhanced Predictor for Video Representation Learning" (ACM MM 2023)
dictionary-learning memory-networks self-supervised-learning video-representation-learning contrative-
Language:Python 16
Video-MAC / VideoMAC
Official code for CVPR2024 “VideoMAC: Video Masked Autoencoders Meet ConvNets”
convnets mae masked-autoencoder self-supervised-learning video-representation-learning video-segmentation
Language:Python 8
furushchev / chainervr
Chainer implementation of Networks for Learning Video Representations
chainer deep-learning video-representation-learning video-representation
Language:Python 7
UARK-AICV / Video_Representation
[Asilomar 2022] Contextual Explainable Video Representation: Human Perception-based Understanding
temporal-action-detection temporal-action-localization video-captioning video-representation video-representation-learning
5
gimpong / AAAI24-GMMFormer
The code for the paper "GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrieval" (AAAI'24)
aaai aaai2024 contrastive-learning cross-modal-retrieval gaussian-mixture-models text-video-retrieval transformer video-representation-learning video-retrieval
Language:Python 2
Mallory24 / cae_dataset
The official repository for creating casual action effect (CAE) dataset for the IJCNLP-AACL 2023 paper: Implicit Affordance Acquisition via Causal Action–Effect Modeling in the Video Domain
commonsense-knowledge language-and-vision video-representation-learning
Language:Python 1
Mallory24 / cae_modeling
The official repository for the IJCNLP-AACL 2023 paper: Implicit Affordance Acquisition via Causal Action–Effect Modeling in the Video Domain
commonsense-knowledge language-and-vision video-representation-learning
Language:Python 1
XFeiF / ComputerVision_PaperNotes
📚 Paper Notes (Computer vision)
action-recognition computer-vision cv cvpr eccv iccv notes paper representation-learning self-supervised-learning tpami video-papernotes video-representation video-representation-learning video-retrieval video-understanding
1
mdnuruzzamanKALLOL / VideoMAE_Tensorflow
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
action-recognition mae pytorch self-supervised-learning tensorflow tensorflow2 transformer video-analytics video-representation-learning video-transformer vision-transformer
Language:Python