SiyeolJung

VmambaIR

This is official implementtaion of "VmambaIR: Visual State Space Model for Image Restoration"

SoundStream

This repository is an implementation of this article: https://arxiv.org/pdf/2107.03312.pdf

MM-Diffusion

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

StyleTTS2

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

LLM-Codec

The open source code for LLM-Codec

AudioLDM2

Text-to-Audio/Music Generation

AudioLDM

AudioLDM: Generate speech, sound effects, music and beyond, with text.

Resemblyzer

A python package to analyze and compare voices with deep learning

Dyadic-Interaction-Modeling

[ECCV 2024] Dyadic Interaction Modeling for Social Behavior Generation

SALMONN

SALMONN: Speech Audio Language Music Open Neural Network

Qinco

Residual Quantization with Implicit Neural Codebooks

vector-quantize-pytorch

Vector (and Scalar) Quantization, in Pytorch

BasicSR

Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.

stable-diffusion

A latent text-to-image diffusion model

sqvae

Pytorch implementation of stochastically quantized variational autoencoder (SQ-VAE)

CVQ-VAE

[ICCV 2023] Online Clustered Codebook

Awesome-Image-Quality-Assessment

A comprehensive collection of IQA papers

MMSI

Code for "Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations" (CVPR 2024 Oral)

OmniTokenizer

OmniTokenizer: one model and one weight for image-video joint tokenization.

VoxMM

IQA-PyTorch

👁️ 🖼️ 🔥PyTorch Toolbox for Image Quality Assessment, including LPIPS, FID, NIQE, NRQM(Ma), MUSIQ, TOPIQ, NIMA, DBCNN, BRISQUE, PI and more...

S2G-MDDiffusion

SyncTalk

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

mixture-of-experts

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

mmvae

Multimodal Mixture-of-Experts VAE

pykan

Kolmogorov Arnold Networks

DistgASR

[TPAMI 2022] DistgASR: Disentangling Mechanism for Light Field Angular Super-Resolution

Grid-Diffusion-Models-for-Text-to-Video-Generation

Official Code Repository for the paper "Grid Diffusion Models for Text-to-Video Generation", CVPR 2024

Generating-Realistic-Images-from-In-the-wild-Sounds

Official Code Repository for the paper "Generating Realistic Images from In-the-wild Sounds", ICCV 2023