multimodal-emotion-recognition

There are 5 repositories under multimodal-emotion-recognition topic.

declare-lab / MELD
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation
emotion-recognition sentiment-analysis multimodal-sentiment-analysis multimodal-interactions dialogue-systems conversational-ai chatbot personality-traits personality-profiling emotion dialogue emotion-detection multimodal-emotion-recognition emotion-recognition-in-conversation
Language:Python 747
Demfier / multimodal-speech-emotion-recognition
Lightweight and Interpretable ML Model for Speech Emotion Recognition and Ambiguity Resolution (trained on IEMOCAP dataset)
speech-emotion-recognition pytorch scikit-learn pandas librosa multimodal-emotion-recognition python3 iemocap lstm
Language:Jupyter Notebook 373
SER-datasets
SuperKogito / SER-datasets
A collection of datasets for the purpose of emotion recognition/detection in speech.
speech-emotion-recognition emotions speech emotions-recognition datasets multimodal-emotion-recognition audio-datasets audio
Language:HTML 244
BERT-like-is-All-You-Need
shamanez / BERT-like-is-All-You-Need
The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
bert-model fine-tuning multimodal-emotion-recognition multimodal-representation pretrained-models self-supervised-learning sentiment-analysis speech-emotion-recognition
Language:Python 110
shamanez / Self-Supervised-Embedding-Fusion-Transformer
The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.
bert emotion-recognition multimodal-deep-learning multimodal-emotion-recognition multimodal-sentiment-analysis self-supervised-learning
Language:Python 104
ankurbhatia24 / MULTIMODAL-EMOTION-RECOGNITION
Human Emotion Understanding using multimodal dataset.
deeplearning deep-learning machine-learning keras audio-visual audio-visualization audio-visual-speech-recognition python tensorflow multimodal-emotion-recognition librosa opensmile
Language:Jupyter Notebook 70
anita-hu / MSAF
Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
multimodal-learning multimodal-sentiment-analysis multimodal-emotion-recognition ntu-rgbd ravdess cmu-mosei pytorch action-recognition multimodal-deep-learning
Language:Python 66
abikaki / awesome-speech-emotion-recognition
😎 Awesome lists about Speech Emotion Recognition
speech-emotion-recognition speech-emotion-classification affective-computing artificial-intelligence awesome awesome-list human-computer-interaction deep-learning emotion machine-learning speech-processing deep-neural-networks emotion-detection emotion-recognition multimodal-emotion-recognition multimodal-sentiment-analysis sentiment-classification emotional-speech expressive-speech-synthesis
48
Vincent-ZHQ / DMER
A survey of deep multimodal emotion recognition.
emotion-recognition multimodal-emotion-recognition multimodal-sentiment-analysis review survey
44
Video-Audio-Face-Emotion-Recognition
rishiswethan / Video-Audio-Face-Emotion-Recognition
The repo contains an audio emotion detection model, facial emotion detection model, and a model that combines both these models to predict emotions from a video
audio-emotion-detection emotion-classification emotion-detection emotion-recognition face-emotion-recognition facial-emotion-detection facial-emotion multimodal-emotion-recognition
Language:Jupyter Notebook 23
bolajixi / Mulitimodal-Speech-Emotion-Recognition
A Tensorflow implementation of Speech Emotion Recognition using Audio signals and Text Data
tensorflow2 tensorflow python3 deep-learning keras-tensorflow iemocap multimodal-emotion-recognition speech-emotion-recognition
Language:Jupyter Notebook 11
mmser
nhattruongpham / mmser
SERVER: Multi-modal Speech Emotion Recognition using Transformer-based and Vision-based Embeddings
attention-lstm audio-embedding multimodal-emotion-recognition speech-emotion-recognition text-embedding gpu-support vggish
Language:Jupyter Notebook 10
rofe-dl / emotion-recognition-ensemble-learning
Emotion recognition from Speech & Text using different heterogeneous ensemble learning methods
emotion-recognition ensemble-learning ensemble-machine-learning iemocap iemocap-database machine-learning multimodal-emotion-recognition supervised-classification
Language:Jupyter Notebook 4
MIntelligence-Group / SpeechImg_EmoRec
Published in Springer Multimedia Tools and Applications Journal.
deep-learning multimodal-emotion-recognition information-fusion interpretability
3
Damorgal / Multimodal-Research-experiments
All experiments were done to classify multimodal data.
deep-learning multimodal-datasets multimodal-deep-learning multimodal-emotion-recognition multimodal-representation transformer-models
2
winston-lin-wei-cheng / MultiScale-Chunk-Regularization
audio-text multimodal emotion recognition model which is robust to missing data
missing-data-treatment multimodal-emotion-recognition audio-text-modeling robust-modeling
Language:Python 2
Jayanth-MKV / emotion2vec-speech-emotion-detection-api
This API utilizes a pre-trained model for emotion recognition from audio files. It accepts audio files as input, processes them using the pre-trained model, and returns the predicted emotion along with the confidence score. The API leverages the FastAPI framework for easy development and deployment.
audio-emotion-detection emotion-recognition multimodal-emotion-recognition pretrained-model realtime-emotion-recognition speech-emotion-recognition
Language:Python 1
INTERSPEECH-2024 / MER
Official repo for "Multi-Corpus Emotion Recognition Method based on Cross-Modal Gated Attention Fusion" in INTERSPEECH 2024
interspeech interspeech2024 computational-linguistics human-computer-interaction multimodal-emotion-recognition transformers gated-feature-fusion
Language:Python 0