Varun-GP

MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

Multimodal-Emotion-Recognition

A real time Multimodal Emotion Recognition web app for text, sound and video inputs

conv-emotion

This repo contains implementation of different architectures for emotion recognition in conversations.

Multimodal-End2end-Sparse

The code repository for NAACL 2021 paper "Multimodal End-to-End Sparse Model for Emotion Recognition".

paz

Hierarchical perception library in Python for pose estimation, object detection, instance segmentation, keypoint estimation, face recognition, etc.

mexca

Multimodal Emotion eXpression Capture Amsterdam. Pipeline for capturing emotion expressions from multiple modalities (video, audio, text) in the wild.

FacialMMT

Code for paper "A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations"

Affective-Computing-Demo

A demo of multimodal emotion recognition built upon Gradio

multimodal-emotion-recognition-DEMO

A demo for multi-modal emotion recognition.(多模态情感识别demo)

pagnerf

PAg-NeRF, a fast and efficient end-to-end panoptic 3D representations for agricultural robotics

imageinwords

Data release for the ImageInWords (IIW) paper.

ViFM_Survey

Foundation Models for Video Understanding: A Survey

snag_release

Official Implementation of SnAG (CVPR 2024)

CVRR-Evaluation-Suite

Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs".

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

LLaVA-Hound-DPO

OpenTrans

SEED-X

Multimodal Models in Real World

SoM-LLaVA

[COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

Stable-Text-to-Motion-Framework

SATO: Stable Text-to-Motion Framework

AI4ASD

child_gesture

awesome-data-labeling

A curated list of awesome data labeling tools

HandRefiner

Hand-CNN

Contextual Attention for Hand Detection in the Wild, ICCV 2019

HPRNet

Bottom-up whole-body pose estimation method in constant time.

yolov7-hand-detection

Hand detection using YOLOv7 with COCO dataset.

Momentor