multimodal-sentiment-analysis

There are 22 repositories under multimodal-sentiment-analysis topic.

declare-lab / MELD
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation
emotion-recognition sentiment-analysis multimodal-sentiment-analysis multimodal-interactions dialogue-systems conversational-ai chatbot personality-traits personality-profiling emotion dialogue emotion-detection multimodal-emotion-recognition emotion-recognition-in-conversation
Language:Python 754
declare-lab / multimodal-deep-learning
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
multimodal-deep-learning multimodal-interactions multimodal-learning multimodal-sentiment-analysis
Language:OpenEdge ABL 660
thuiar / MMSA
MMSA is a unified framework for Multimodal Sentiment Analysis.
multimodal-sentiment-analysis multi-task-learning dataset framework
Language:Python 591
microsoft / UniVL
An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
multimodality video-text pretraining youcookii retrieval-task msrvtt caption pretrain video caption-task video-language multimodal-sentiment-analysis localization segmentation coin joint alignment video-text-retrieval
Language:Python 330
YeexiaoZheng / Multimodal-Sentiment-Analysis
多模态情感分析——基于BERT+ResNet的多种融合方法
multimodal multimodal-sentiment-analysis pytorch torchvision transformer attention
Language:Python 175
declare-lab / Multimodal-Infomax
This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.
multimodal-deep-learning multimodal-fusion multimodal-sentiment-analysis
Language:Python 146
declare-lab / contextual-utterance-level-multimodal-sentiment-analysis
Context-Dependent Sentiment Analysis in User-Generated Videos
keras lstm lstm-neural-networks multimodal-interactions multimodal-sentiment-analysis sentiment-analysis
Language:Python 121
thuiar / MMSA-FET
A Tool for extracting multimodal features from videos.
multimodal-deep-learning multimodal-sentiment-analysis
Language:Python 119
shamanez / Self-Supervised-Embedding-Fusion-Transformer
The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.
bert emotion-recognition multimodal-deep-learning multimodal-emotion-recognition multimodal-sentiment-analysis self-supervised-learning
Language:Python 106
thuiar / Cross-Modal-BERT
CM-BERT: Cross-Modal BERT for Text-Audio Sentiment Analysis（MM2020）
multimodal-sentiment-analysis cross-modal-bert acmmm2020
Language:Python 98
PreferredAI / vista-net
Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19
attention-mechanism multimodal-learning multimodal-sentiment-analysis sentiment-analysis
Language:Python 89
anita-hu / MSAF
Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
multimodal-learning multimodal-sentiment-analysis multimodal-emotion-recognition ntu-rgbd ravdess cmu-mosei pytorch action-recognition multimodal-deep-learning
Language:Python 67
declare-lab / BBFN
This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis
multimodal-sentiment-analysis multimodal-deep-learning huggingface-transformers multimodal-representation
Language:Python 61
abikaki / awesome-speech-emotion-recognition
😎 Awesome lists about Speech Emotion Recognition
speech-emotion-recognition speech-emotion-classification affective-computing artificial-intelligence awesome awesome-list human-computer-interaction deep-learning emotion machine-learning speech-processing deep-neural-networks emotion-detection emotion-recognition multimodal-emotion-recognition multimodal-sentiment-analysis sentiment-classification emotional-speech expressive-speech-synthesis
50
NUSTM / FacialMMT
Code for paper "A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations"
emotion-recognition face-detection facial-expression-recognition multi-task-learning multimodal-sentiment-analysis
Language:Python 50
declare-lab / hfusion
Multimodal sentiment analysis using hierarchical fusion with context modeling
sentiment-analysis multimodal-sentiment-analysis multimodal-interactions multimodal-fusion fusion emotion-recognition emotion-detection emotion-analysis data-fusion
Language:Python 44
Vincent-ZHQ / DMER
A survey of deep multimodal emotion recognition.
emotion-recognition multimodal-emotion-recognition multimodal-sentiment-analysis review survey
44
Haoyu-ha / ALMT
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis
multimodal-learning multimodal-sentiment-analysis sentiment-analysis transformer
Language:Python 43
XL2248 / MSCTD
Code and Data for the ACL22 main conference paper "MSCTD: A Multimodal Sentiment Chat Translation Dataset"
chat-translation multimodal-chat-translation multimodal-machine-translation multimodal-sentiment-analysis
Language:Python 40
declare-lab / MSA-Robustness
NAACL 2022 paper on Analyzing Modality Robustness in Multimodal Sentiment Analysis
multimodal-deep-learning multimodal-sentiment-analysis robustness-analysis
Language:Python 31
Kaicheng-Yang0828 / Multimodal-Sentiment-Analysis-Paper-list
This paper list is about multimodal sentiment analysis.
multimodal-sentiment-analysis
29
roshansridhar / Multimodal-Sentiment-Analysis
Engaged in research to help improve to boost text sentiment analysis using facial features from video using machine learning.
data-cleaning multimodal-sentiment-analysis pandas bag-of-words nltk svm logistic-regression sparse-matrix classification-report cross-validation recursive-feature-elimination count-vectorizer tf-idf machine-translation moud mosi openear openface utterance
Language:Jupyter Notebook 28
declare-lab / MM-Align
[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences"
machine-learning multimodal-deep-learning multimodal-sentiment-analysis natural-language-processing optimal-transport
Language:Python 22
sverma88 / DeepCU-IJCAI19
DeepCU: Integrating Both Common and Unique Latent Information for Multimodal Sentiment Analysis, IJCAI-19
multimodal-deep-learning sentiment-analysis data-fusion factorization-machines common-and-unique-information tensor-convolution-networks tensorflow multimodal-sentiment-analysis
Language:Python 19
vkeswani / IITK_Memotion_Analysis
Bimodal and Unimodal Sentiment Analysis of Internet Memes (Image+Text)
sentiment-analysis natural-language-processing nlp bert mmbt mmbt-model bert-fine-tuning naive-bayes ffnn cnn svm multimodal-sentiment-analysis word2vec
Language:Python 12
WangJingyao07 / Multimodal-Sentiment-Analysis-for-Health-Navigation
Emotion recognition methods through facial expression, speeches, audios, and multimodal data
audio-emotion-detection facial-expression-recognition multimodal-learning multimodal-sentiment-analysis speech-emotion-recognition
Language:Jupyter Notebook 12
imadhou / multimodal-sentiment-analysis
Multimodal sentiment analysis
multimodal-classification multimodal-fusion multimodal-learning multimodal-sentiment-analysis sentiment-analysis sentiment-classification twitter-sentiment-analysis
Language:Jupyter Notebook 9
cleopatra-itn / fair_multimodal_sentiment
Code and Splits for the paper "A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods", In Proceedings of the 2021 Workshop on Multi-Modal Pre-Training for Multimedia Understanding (MMPT ’21), August 21, 2021,Taipei, Taiwan
sentiment-classification multimodality transformers multimodal-sentiment-analysis twitter neural-networks
Language:Python 7
ichalkiad / cryptogpcausality
This repository contains the code for the paper "Sentiment-driven statistical causality in multimodal systems", by Ioannis Chalkiadakis, Anna Zaremba, Gareth W. Peters and Michael J. Chantler.
gaussian-processes sentiment-analysis cryptocurrency cryptocurrency-exchanges statistical-models causality-analysis causal-inference causality natural-language-procressing public-news text-mining multimodal-sentiment-analysis multimodal-learning
Language:MATLAB 6
mongodb-developer / Google-Cloud-Sentiment-Analysis-Summarization
Sentiment Analysis, Summarization, Tagging with MongoDB Atlas and Gemini — Google Cloud's AI model
gemini gemini-pro gemini-pro-vision mongodb mongodb-atlas multimodal-sentiment-analysis
Language:TypeScript 6
Baibhav-nag / Multimodal-emotion-recognition
Multimodal emotion recognition on two benchmark datasets RAVDESS and SAVEE from audio-visual information using CNN(Convolutional Neural Networks)
audio-visual-features multimodal-sentiment-analysis cnn-model
Language:Jupyter Notebook 5
ttrikn / EMVAS
Open source code for paper: End-to-End Multimodal Emotion Visualization Analysis System
deep-learning emotion-recognition multimodal-sentiment-analysis
Language:Python 5
elsobhano / Multimodal-Emotion-Recognition
Multimodal Emotion Recognition using ClipBERT.
bert-fine-tuning emotion-detection emotion-recognition multimodal-deep-learning multimodal-sentiment-analysis
Language:Python 4
SrishtiVashishtha / Inferring-Sentiments-from-Supervised-Classification-of-Text-and-Speech-cues-using-Fuzzy-Rules
Multimodal Sentiment Analysis of video reviews on social media platform, using a supervised fuzzy rule-based system.
fuzzy-logic fuzzy-rules multimodal-sentiment-analysis sentiment-analysis sentiment-classification social-media speech-cues svm textfeatures youtube
Language:Python 4
clp-research / language-models-multimodal-tasks
Official Git repository for "Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics (ACL 2023 Findings)"
language-model multimodal-datasets multimodal-learning multimodal-sentiment-analysis
Language:Python 3
Vamos66 / MTAMW
multimodal-sentiment-analysis
Language:Python 3

multimodal-sentiment-analysis

declare-lab / MELD

declare-lab / multimodal-deep-learning

thuiar / MMSA

microsoft / UniVL

YeexiaoZheng / Multimodal-Sentiment-Analysis

declare-lab / Multimodal-Infomax

declare-lab / contextual-utterance-level-multimodal-sentiment-analysis

thuiar / MMSA-FET

shamanez / Self-Supervised-Embedding-Fusion-Transformer

thuiar / Cross-Modal-BERT

PreferredAI / vista-net

anita-hu / MSAF

declare-lab / BBFN

abikaki / awesome-speech-emotion-recognition

NUSTM / FacialMMT

declare-lab / hfusion

Vincent-ZHQ / DMER

Haoyu-ha / ALMT

XL2248 / MSCTD

declare-lab / MSA-Robustness

Kaicheng-Yang0828 / Multimodal-Sentiment-Analysis-Paper-list

roshansridhar / Multimodal-Sentiment-Analysis

declare-lab / MM-Align

sverma88 / DeepCU-IJCAI19

vkeswani / IITK_Memotion_Analysis

WangJingyao07 / Multimodal-Sentiment-Analysis-for-Health-Navigation

imadhou / multimodal-sentiment-analysis

cleopatra-itn / fair_multimodal_sentiment

ichalkiad / cryptogpcausality

mongodb-developer / Google-Cloud-Sentiment-Analysis-Summarization

Baibhav-nag / Multimodal-emotion-recognition

ttrikn / EMVAS

elsobhano / Multimodal-Emotion-Recognition

SrishtiVashishtha / Inferring-Sentiments-from-Supervised-Classification-of-Text-and-Speech-cues-using-Fuzzy-Rules

clp-research / language-models-multimodal-tasks

Vamos66 / MTAMW