Jesjes1233

MIMRL

The implementation codes of paper: Multimodal Sentiment Analysis with Mutual Information-based Disentangled Representation Learning

MInD

Code for MInD: Multimodal Information Disentanglement

Multimodal_Disentanglement

DTN

Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology

Meta-NA

Pytorch implementation for codes in Meta Noise Adaption Framework for Multimodal Sentiment Analysis with Feature Noise (Accepted by IEEE Transactions on Multimedia).

multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

CMU-MultimodalSDK

TFR-Net

This repository contains the official implementation code of the paper Transformer-based Feature Reconstruction Network for Robust Multimodal Sentiment Analysis, accepted at ACMMM 2021.

M-SENA

M-SENA: All-in-One Platform for Multimodal Sentiment Analysis

ch-sims-v2

Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

Self-MM

Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"

MMSA-FET

A Tool for extracting multimodal features from videos.

AWESOME-MSA

Paper List for Multimodal Sentiment Analysis

MultiEMO

MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations (ACL 2023)

multimodal_emotion_recognition

Improved Multi-modal Emotion Recognition using Squeeze-and-Exciation Block in Cross-Modal Attention

MERTools

Toolkits for Multimodal Emotion Recognition

mexca

Multimodal Emotion eXpression Capture Amsterdam. Pipeline for capturing emotion expressions from multiple modalities (video, audio, text) in the wild.

MMSA

MMSA is a unified framework for Multimodal Sentiment Analysis.

FV2ES

A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition

DynMM

Code for the paper 'Dynamic Multimodal Fusion'

MetaTransformer

Meta-Transformer for Unified Multimodal Learning

Multimodal-Transformer

[ACL'19] [PyTorch] Multimodal Transformer

EfficientAT

This repository aims at providing efficient CNNs for Audio Tagging. We provide AudioSet pre-trained models ready for downstream training and extraction of audio embeddings.

VisDrone-Dataset

The dataset for drone based detection and tracking is released, including both image/video, and annotations.

Audio-signal-classification-and-identification

基于梅尔频谱的信号分类和识别

all-MiniLM-L6-v2

llmprivacy

Awesome-LLM-Safety

A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide researchers, practitioners, and enthusiasts with insights into the safety implications, challenges, and advancements surrounding these powerful models.

ltp

Language Technology Platform