Varun-GP

MMA-DFER

This repository provides an official implementation for the paper MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wild.

2024-ICLR-Norton

Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]

TimeChat

[CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding

Awesome-MLLM-Hallucination

📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

MyVLM

Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)

MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

EmoCLIP

EmotionCLIP

[CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"

PLLaVA

Official repository for the paper PLLaVA

furuta_pendulum

LQR, MPC and DRL approaches to control the Furuta pendulum.

roomac_ros

ROS packages for roomac autonomous mobile manipulation robot

T3AL

Official Pytorch implementation of "Test-Time Zero-Shot Temporal Action Localization", CVPR 2024

DDAMFN

MA-LMM

(2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

PySceneDetect

:movie_camera: Python and OpenCV-based scene cut/transition detection program & library.

diarizers

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

LaughDetection

laughter

Learning embeddings for laughter categorization

portaudio

PortAudio is a cross-platform, open-source C language library for real-time audio input and output.

ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

Real-Time-Sound-Event-Detection

This repository contains the python implementation of a Sound Event Detection systems working in real time.

PromptingWhisper

Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation

laughter-detection

llama3

The official Meta Llama 3 GitHub site

Caption-Anything

Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything

MemGPT

Create LLM agents with long-term memory and custom tools 📚🦙

PCA-EVAL

[ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain

Awesome_Multimodel_LLM

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context learning, visual reasoning, foundational models, and more. Stay updated with the latest advancement.