video-language-understanding

There are 0 repository under video-language-understanding topic.

• whwu95 / Cap4Video

  【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?

  cross-modal-learningvideo-language-understandingvideo-text-retrievalvideo-understanding
  Language:Python 248

• whwu95 / BIKE

  【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

  action-recognitioncross-modal-learningvideo-language-understandingvideo-recognitionvideo-understanding
  Language:Python 162

• YangLing0818 / EditWorld

  EditWorld: Simulating World Dynamics for Instruction-Following Image Editing

  image-editinginstruction-followinglarge-language-modelstext-to-imagevideo-language-understanding
  Language:Python 122

• doc-doc / NExT-GQA

  Can I Trust Your Answer? Visually Grounded Video Question Answering (CVPR'24, Highlight)

  video-question-answeringvideoqatrustworthy-vqavisual-evidence-groundingvideo-language-understandingvideo-grounding
  Language:Python 60

• bigai-nlco / VideoLLaMB

  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges

  long-contextvideo-language-pretrainingvideo-language-understanding
  Language:Python 55

• liveseongho / Awesome-Video-Language-Understanding

  A Survey on video and language understanding.

  awesome-papersdeep-learningmachine-learningmultimodal-deep-learningvideo-languagevideo-language-pretrainingvideo-language-understandingdatasetpaper
  48

• sail-sg / VGT

  Video Graph Transformer for Video Question Answering (ECCV'22)

  graph-transformertemporal-dynamicsvideo-language-understandingvideo-question-answeringvideoqa
  Language:Python 46

• houzhijian / CONQUER

  [2021 MultiMedia] CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrieval

  video-language-understanding
  Language:Python 36

• MikeWangWZHL / Paxion

  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight

  video-language-understanding
  Language:Python 35

• knightyxp / DGL

  [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.

  cross-modal-learningcross-modal-retrievalparameter-efficient-tuningprompt-tuningvideo-language-understandingvideo-text-retrieval
  Language:Python 31

• houzhijian / CONE

  [2023 ACL] CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding

  video-language-understanding
  Language:Python 28

• doc-doc / CoVGT

  Contrastive Video Question Answering via Video Graph Transformer (IEEE T-PAMI'23)

  contrastive-learningdynamic-visual-graphvideo-language-understandingvideoqavideo-question-answering
  Language:Python 19

• zinengtang / DeCEMBERT

  Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)

  videovideo-languagevideo-language-understandingvision-language
  Language:Python 17

• houzhijian / GroundNLQ

  The champion solution for Ego4D Natural Language Queries Challenge in CVPR 2023

  egocentric-visionvideo-language-understanding
  Language:Python 16

• Maddy12 / SSL4VideoSurvey

  The official GitHub page for the survey paper "Self-Supervised learning for Videos: A survey"

  action-recognitioncomputer-visionpre-trainingtext-to-videovideo-languagevideo-language-pretrainingvideo-language-understandingvideo-to-video
  4

• jena-shreyas / Awesome-Video-Language-Resources

  A repository of Video Language papers, code and datasets.

  multimodalmultimodal-deep-learningvideo-languagevideo-language-understanding
  0