dense-video-captioning

There are 2 repositories under dense-video-captioning topic.

ttengwang / Awesome_Long_Form_Video_Understanding
Awesome papers & datasets specifically focused on long-term videos.
audio-visual-event-localization dense-video-captioning long-term-video temporal-action-detection temporal-action-localization temporal-sentence-grounding video-dataset video-grounding video-large-language-models video-llms video-representation-learning
258
BMT
v-iashin / BMT
Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)
pytorch bi-modal-transformer dense-video-captioning audio video i3d activitynet-captions multimodal-fusion temporal-action-proposals bmvc bmvc20 bmt proposal-generator video-features bi-modal-encoder transformer
Language:Jupyter Notebook 227
ttengwang / PDVC
End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
activitynet-captions dense-video-captioning video-paragraph-captioning youcook2
Language:Python 215
antoyang / VidChapters
[NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scale
dense-video-captioning multimodal-learning pre-training temporal-language-grounding video-captioning video-understanding vision-and-language weakly-supervised-learning vid2seq video-chapter-generation
Language:Jupyter Notebook 188
JaywongWang / DenseVideoCaptioning
Official Tensorflow Implementation of the paper "Bidirectional Attentive Fusion with Context Gating for Dense Video Captioning" in CVPR 2018, with code, model and prediction results.
dense-video-captioning
Language:Python 149
v-iashin / MDVC
PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)
pytorch transformer multi-modal dense-video-captioning cvpr-workshop audio visual speech i3d activitynet-captions
Language:Python 144
gyxxyg / VTG-LLM
[AAAI 2025] VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
dense-video-captioning moment-retrieval multi-modal-large-language-model video-highlight-detection video-large-language-models
Language:Python 94
gyxxyg / TRACE
[ICLR 2025] TRACE: Temporal Grounding Video LLM via Casual Event Modeling
dense-video-captioning multimodal-large-language-models video-highlight-detection video-large-language-models video-temporal-grounding
Language:Python 75
ttengwang / dense-video-captioning-pytorch
Second-place solution to dense video captioning task in ActivityNet Challenge (CVPR 2020 workshop)
dense-video-captioning hierarchical-rnn activitynet-captions activitynet-challenge
Language:Python 75
ailab-kyunghee / CM2_DVC
[CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval
cross-modal-retrieval dense-video-captioning dvc memory multi-modal retrieval video video-cap
Language:Python 53
LuoweiZhou / densecap
Dense video captioning in PyTorch
activitynet-captions dense-video-captioning transformer video-captioning youcook2
Language:Jupyter Notebook 41
zjr2000 / GVL
Official implementation for paper Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos
dense-video-captioning pytorch pytorch-implementation representation-learning temporal-localization video-grounding video-language long-video-understanding
Language:Python 27
mlvlab / VidChain
Official Implementation (Pytorch) of the "VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning", AAAI 2025
aaai2025 dense-video-captioning direct-preference-optimization long-video-understanding multimodal-large-language-models
Language:Python 16
josch14 / semantic-metadata-extraction-from-videos
Semantic Metadata Extraction from Generated Video Captions (CD-MAKE 2023).
dense-video-captioning entities framework relations semantic-metadata text video
Language:Python 8