video-language-model

There are 0 repository under video-language-model topic.

• Coobiw / MPP-LLaVA

  Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

  multimodal-large-language-modelsdeepspeedmodel-parallelpipeline-parallelismmllmqwenfine-tuningpretrainingvideo-language-modelvideo-large-language-models
  Language:Jupyter Notebook 471

• TencentARC / ST-LLM

  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"

  large-language-modelsvideo-language-modelvideo-understanding
  Language:Python 145

• patrick-tssn / VideoHallucer

  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)

  hallucination-detectionmultimodal-large-language-modelsvideo-language-modelvideo-hallucination
  Language:Python 27

• moucheng2017 / SOP-LVM-ICL-Ensemble

  [NeurIPS VLM workshop 2024] In-Context Ensemble Learning from Pseudo Labels Improves Video-Language Models for Low-Level Workflow Understanding

  ensemblein-context-learningmultimodal-large-language-modelspseudo-labelingsopsvideo-language-modelin-context-ensemble
  Language:Python 22

• ALucek / multimodal-llm-breakdown

  Outlining and demonstrating how language models are able to understand image, video, and text content.

  audio-language-modelmultimodalmultimodal-large-language-modelsvideo-language-modelvision-language-model
  Language:Jupyter Notebook 6

• ekazakos / grove

  Code implementation for the paper "Large-scale Pre-training for Grounded Video Caption Generation"

  automatic-annotationlarge-scale-pretrainingvideo-captioningvideo-groundingvideo-language-modelvideo-language-pretrainngvision-language
  6