zscjojo

ViewRecord

Android View Record: Screen Record, Video Record, Audio Record, 安卓录屏，或者说app内录屏，避开隐私问题，不会录到系统通知之类的，View级别的录屏，支持同时录音

bert

TensorFlow code and pre-trained models for BERT

GDPNet

Self-MM

Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"

MUStARD

Multimodal Sarcasm Detection Dataset

data-of-multimodal-sarcasm-detection

MCSH

MCSH: A Multimodal Chinese Sarcasm and Humor Dataset for Implicit Sentiment Analysis

UR-FUNNY

This repository presents UR-FUNNY dataset: first dataset for multimodal humor detection

transfuser

[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving; [CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Perceiver

Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow

perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

modulated_fusion_transformer

Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition

MOSEI_UMONS

A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis

METER

METER: A Multimodal End-to-end TransformER Framework

MSAF

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

mmtm

Implementation of CVPR 2020 paper "MMTM: Multimodal Transfer Module for CNN Fusion"

multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

Low-rank-Multimodal-Fusion

This is the repository for "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors", Liu and Shen, et. al. ACL 2018

multimodalAnalysis

Python examples for the course "Multimodal Information Processing & Analysis" of the MSc in Data Science in NCSR Demokritos

BERT_multimodal_transformer

CEN

[TPAMI 2022, NeurIPS 2020] Code release for "Deep Multimodal Fusion by Channel Exchanging"

M-SENA

M-SENA: All-in-One Platform for Multimodal Sentiment Analysis

Cross-Modal-BERT

CM-BERT: Cross-Modal BERT for Text-Audio Sentiment Analysis（MM2020）

TomBERT

Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"

contextual-utterance-level-multimodal-sentiment-analysis

Context-Dependent Sentiment Analysis in User-Generated Videos

multimodal-sentiment-analysis

Attention-based multimodal fusion for sentiment analysis

Deep-HOSeq--ICDM-2020

Deep-HOSeq: Deep Higher-Order Sequence Fusion for Multimodal Sentiment Analysis.

conv-emotion

This repo contains implementation of different architectures for emotion recognition in conversations.

HiGRUs

Implementation of the paper "Hierarchical GRU for Utterance-level Emotion Recognition" in NAACL-2019.