lzxai

Vision-KAN

KAN for Vision Transformer

MultiMAE-DER

TensorFlow code implementation of "MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition"

fusemix

Data-Efficient Multimodal Fusion on a Single GPU

FV2ES

A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition

CFN-SR

Joint-Cross-Attention-for-Audio-Visual-Fusion

IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"

scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

abaw5

5th ABAW Competition

CCIM

[CVPR2023] Context De-confounded Emotion Recognition

AV4SER

PyTorch implementation for Audio-Visual Domain Adaptation Feature Fusion for Speech Emotion Recognition

speech-emotion-recognition-iemocap

Detect emotion from audio signals of IEMOCAP dataset using multi-modal approach. Utilized acoustic features, mel-spectrogram and text as input data to ML/DL models

AWESOME-FER

Top conferences & Journals focused on Facial expression recognition (FER)/ Facial action unit (FAU)

pytorch-facial-expression-recognition

Lightweight Facial Expression(emotion) Recognition model

MMEmotionRecognition

Repository with the code of the paper: A proposal for Multimodal Emotion Recognition using auraltransformers and Action Units on RAVDESS dataset

multimodal-emotion-recognition

This repository provides implementation for the paper "Self-attention fusion for audiovisual emotion recognition with incomplete data".

opensmile-python

Python package for openSMILE

CLUB

Code for ICML2020 paper - CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information

MMSA

MMSA is a unified framework for Multimodal Sentiment Analysis.

Low-rank-Multimodal-Fusion

This is the repository for "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors", Liu and Shen, et. al. ACL 2018

MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

DMER

A survey of deep multimodal emotion recognition.

Mead

MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face Generation [ECCV2020]

MSAF

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

Food-Recipe-CNN

food image to recipe with deep convolutional neural networks.

LoLEmoGameRecognition

Multimodal Joint Emotion and Game Context Recognition in League of Legends Livestreams

SERN

A Self-Attentive Emotion Recognition Network

multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

Multimodal-Emotion-Recognition

This repository contains the code for the paper `End-to-End Multimodal Emotion Recognition using Deep Neural Networks`.

conv-emotion

This repo contains implementation of different architectures for emotion recognition in conversations.

emotion-recognition-using-speech

Building and training Speech Emotion Recognizer that predicts human emotions using Python, Sci-kit learn and Keras