zeroQiaoba

AffectGPT

Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT

MER2023-Baseline

Baseline code for MER 2023 http://merchallenge.cn/mer2023

GCNet

GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"

IRNet

Official code of "IRNet: Iterative Refinement Network for Noisy Partial Label Learning"

DALI

Official code of "DALI: Dynamically Adjusted Label Importance for Noisy Partial Label Learning"

voice-conversion

Homepage

https://zeroqiaoba.github.io/Homepage/

tinyrenderer

A brief computer graphics / rendering course

awesome-emotion-recognition-in-conversations

A comprehensive reading list for Emotion Recognition in Conversations

ChildTuning

Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》

facenet

Face recognition using Tensorflow

Former-DFER

“Former-DFER: Dynamic Facial Expression Recognition Transformer”, ACM MM 2021.

FT-w2v2-ser

Official implementation for the paper Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition

GAIA-det

A Transfer Learning System in Object Detection

JDMAN

Multimodal-Transformer

[ACL'19] [PyTorch] Multimodal Transformer

serab

SERAB: a multi-lingual benchmark for speech emotion recognition

AR-voice-conversion

auto-regressive voice conversion

awesome-diarization

A curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

CMU-MultimodalSDK

CMU MultimodalSDK is a machine learning platform for development of advanced multimodal models as well as easily accessing and processing multimodal datasets.

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

libfacedetection

An open source library for face detection in images. The face detection speed can reach 1000FPS.

nlu-meta-dataset

A meta-dataset for learning to perform few-shot intent classification.

oos-eval

Repository that accompanies "An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction" (EMNLP 2019)

OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.

personality-prediction

Experiments for automated personality detection using Language Models and psycholinguistic features on various famous personality datasets including, the essays dataset (Big-Five personality labelled traits)

pika

a lightweight speech processing toolkit based on Pytorch and (Py)Kaldi

pytorch_geometric

Geometric Deep Learning Extension Library for PyTorch

self-critical.pytorch

Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.

VC-Demo

voice conversation demos