video-understanding

There are 28 repositories under video-understanding topic.

open-mmlab / mmaction2
OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
action-recognition temporal-action-localization pytorch video-understanding tsn i3d slowfast ava spatial-temporal-action-detection benchmark tsm x3d non-local deep-learning openmmlab posec3d video-classification uniformerv2
Language:Python 3936
jinwchoi / awesome-action-recognition
A curated list of action recognition and related area resources
awesome-list awesome action-recognition action-classification action-detection activity-recognition activity-understanding video-understanding video-recognition video-processing object-recognition pose-estimation
3726
OpenGVLab / Ask-Anything
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
captioning-videos chatgpt gradio langchain video-question-answering video-understanding stablelm chat video big-model foundation-models large-language-models large-model
Language:Python 2717
showlab / Awesome-Video-Diffusion
A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.
awesome diffusion-models video-editing video-generation video-understanding video-restoration text-to-motion text-to-video
2513
mit-han-lab / temporal-shift-module
[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding
acceleration low-latency temporal-modeling video-understanding efficient-model nvidia-jetson-nano tsm
Language:Python 2021
open-mmlab / mmaction
An open-source toolbox for action understanding based on PyTorch
action-detection action-recognition pytorch spatial-temporal-action-detection temporal-action-detection temporal-action-localization video-understanding
Language:Python 1850
yjxiong / temporal-segment-networks
Code & Models for Temporal Segment Networks (TSN) in ECCV 2016
action-recognition temporal-segment-networks video-understanding
Language:Python 1513
PaddlePaddle / PaddleVideo
Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.
video-recognition tsm slowfast tsn bmn action-recognition youtube-8m kinetics400 video-understanding activitynet action-detection temporal-action-detection action-localization ava actbert pp-tsm videotag st-gcn t2vlad
Language:Python 1432
MCG-NJU / VideoMAE
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
self-supervised-learning action-recognition video-understanding masked-autoencoder transformer vision-transformer video-transformer mae pytorch video-representation-learning video-analysis neurips-2022
Language:Python 1226
yjxiong / tsn-pytorch
Temporal Segment Networks (TSN) in PyTorch
action-recognition deep-learning pytorch temporal-segment-networks video-understanding
Language:Python 1057
OpenGVLab / InternVideo
Video Foundation Models & Data for Multimodal Understanding
foundation-models video-understanding vision-transformer action-recognition masked-autoencoder multimodal open-set-recognition spatio-temporal-action-localization temporal-action-localization video-question-answering video-retrieval zero-shot-classification zero-shot-retrieval benchmark contrastive-learning self-supervised instruction-tuning video-data video-dataset video-clip
Language:Python 983
TheShadow29 / awesome-grounding
awesome grounding: A curated list of research papers in visual grounding
computer-vision natural-language-processing grounding awesome-list papers arxiv visual-grounding image-grounding video-understanding video-grounding captioning-images captioning-videos embodied-agent multimodal-deep-learning language-grounding paper paper-roadmap phrase-grounding
965
PKU-YuanGroup / Chat-UniVi
[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
image-understanding large-language-models video-understanding vision-language-model
Language:Python 645
yjxiong / action-detection
temporal action detection with SSN
action-recognition action-detection temporal-activity-localization video-understanding structured-segment-networks
Language:Python 641
henghuiding / MeViS
[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions
mevis-dataset mose-dataset multimodal-learning referring-expression-comprehension referring-expression-segmentation referring-video-object-segmentation video-understanding
Language:Python 459
yoosan / video-understanding-dataset
A collection of recent video understanding datasets, under construction!
video-understanding datasets computer-vision action-recognition
447
chihyaoma / Activity-Recognition-with-CNN-and-RNN
Temporal Segments LSTM and Temporal-Inception for Activity Recognition
activity-recognition video-understanding torch lstm-neural-networks convolutional-neural-networks
Language:Lua 439
OpenGVLab / VideoMAEv2
[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking
action-detection action-recognition cvpr2023 foundation-model self-supervised-learning temporal-action-detection video-understanding
Language:Python 411
Vision-CAIR / MiniGPT4-video
Official code for MiniGPT4-video
video-question-answering video-understanding
Language:Python 377
MCG-NJU / TDN
[CVPR 2021] TDN: Temporal Difference Networks for Efficient Action Recognition
action-recognition cvpr2021 pytorch temporal-modeling video-classification video-understanding
Language:Python 362
v-iashin / SpecVQGAN
Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)
transformer vqvae gan pytorch audio-generation video-features melgan multi-modal video-understanding vggsound vas bmvc evaluation-metrics audio video
Language:Jupyter Notebook 319
movienet / movienet-tools
Tools for movie and video research
movie computer-vision video-understanding action-recognition deep-learning vision-language cross-modality shot-detection person-analysis
Language:C++ 252
JunweiLiang / Multiverse
Dataset, code and model for the CVPR'20 paper "The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction". And for the ECCV'20 SimAug paper.
trajectory-prediction trajectory-prediction-benchmark computer-vision video-understanding 3d-simulation
Language:Python 250
NVlabs / STEP
STEP: Spatio-Temporal Progressive Learning for Video Action Detection. CVPR'19 (Oral)
action-detection spatial-temporal spatio-temporal video-action action-recognition ava ava-dataset ucf101 ucf101-dataset amp apex step iterative ucf24 ucf24-dataset video-understanding activity-recognition activity-detection video-activity
Language:Python 246
hustvl / TeViT
Temporally Efficient Vision Transformer for Video Instance Segmentation, CVPR 2022, Oral
instance-segmentation video-instance-segmentation video-understanding
Language:Python 233
rohitgirdhar / ActionVLAD
ActionVLAD for video action classification (CVPR 2017)
action-recognition deep-learning tensorflow video-processing video-understanding
Language:Python 219
alibaba-mmai-research / TAdaConv
[ICLR 2022] TAda! Temporally-Adaptive Convolutions for Video Understanding. This codebase provides solutions for video classification, video representation learning and temporal detection.
action-localization action-recognition pytorch self-supervised-learning tadaconv video-classification video-understanding
Language:Python 216
rlleshi / phar
deep learning sex position classifier
action-recognition deep-learning porn-filter pornhub pytorch video-classification video-understanding human-action-recognition sex sex-classifier
Language:Python 208
whwu95 / Cap4Video
【CVPR'2023 Highlight】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
cross-modal-learning video-language-understanding video-text-retrieval video-understanding
Language:Python 207
whwu95 / Text4Vis
【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective
cross-modal-learning transfer-learning video-recognition video-understanding action-recognition
Language:Python 197
wangheda / youtube-8m
The 2nd place Solution to the Youtube-8M Video Understanding Challenge by Team Monkeytyping (based on tensorflow)
computer-vision deep-learning ensemble-learning tensorflow video-understanding youtube-8m
Language:Python 177
fabienbaradel / object_level_visual_reasoning
Pytorch Implementation of "Object level Visual Reasoning in Videos", F. Baradel, N. Neverova, C. Wolf, J. Mille, G. Mori , ECCV 2018
eccv-2018 computer-vision video-understanding human-object-interaction
Language:Python 173
chinancheng / awesome-activity-prediction
Paper list of activity prediction and related area
action-prediction action-recognition activity-prediction activity-recognition activity-understanding awesome-list video-understanding
169
SoccerNet / sn-gamestate
SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap (CVPR24 - CVSports workshop)
detection multi-object-tracking re-identification soccer soccernet sports sports-analytics tracking video-understanding digit-re
Language:Python 169
TubeDETR
antoyang / TubeDETR
[CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers
spatio-temporal-video-grounding stvg vidstg hc-stvg vision-and-language multimodal-learning video-understanding visual-grounding
Language:Python 161
cmhungsteve / SSTDA
[CVPR 2020] Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation (PyTorch)
action-segmentation cvpr2020 domain-adaptation domain-discrepancy pytorch self-supervised-learning temporal-dynamics video video-understanding
Language:Python 154