Artinacode

VideoLLaMA2

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

PromptPET

PromptPET: A comprehensive toolkit for Prompt Engineering, offering advanced tools for crafting, refining, and optimizing prompts and flow engineering processes

HRNet-Facial-Landmark-Detection

This is an official implementation of facial landmark detection for our TPAMI paper "Deep High-Resolution Representation Learning for Visual Recognition". https://arxiv.org/abs/1908.07919

SpeechEmoRec

Speech Emotion Recognition Using Deep Convolutional Neural Network and Discriminant Temporal Pyramid Matching

MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

BERT_multimodal_transformer

Multimodal-Transformer

[ACL'19] [PyTorch] Multimodal Transformer

CA-MSER

Code for Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information

llm-universe

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

TinyRAG

TinyRAG

Plug-and-Play

深度学习中各种即插即用小模块

torchkeras

Pytorch❤️ Keras 😋😋

MIRNet

[ECCV 2020] Learning Enriched Features for Real Image Restoration and Enhancement. SOTA results for image denoising, super-resolution, and image enhancement.

Firefly

Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Image-Classification-PyTorch

Learning and Building Convolutional Neural Networks using PyTorch

lightning-hydra-template

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

Self-MM

Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"

CMU-MultimodalSDK

multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

BBFN

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Multimodal-Emotion-Recognition

This repository contains the code for the paper `End-to-End Multimodal Emotion Recognition using Deep Neural Networks`.

Multimodal-Emotion-Recognition

A real time Multimodal Emotion Recognition web app for text, sound and video inputs

awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

pytorch-lightning-learn

mmbt

Supervised Multimodal Bitransformers for Classifying Images and Text

Chinese-Text-Classification-PyTorch

中文文本分类任务，基于PyTorch实现（TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_Attention, DPCNN, Transformer，Bert，ERNIE），开箱即用！

magic-python

Python 黑魔法手册

X-AnyLabeling

Effortless data labeling with AI support from Segment Anything and other awesome models.