fseasy

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

InstantID

InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥

demucs

Code for the paper Hybrid Spectrogram and Waveform Source Separation

jukebox

Code for the paper "Jukebox: A Generative Model for Music"

denoising-diffusion-pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

point-e

Point cloud diffusion for 3D model synthesis

guided-diffusion

OOTDiffusion

Official implementation of OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on

dust3r

DUSt3R: Geometric 3D Vision Made Easy

audio2photoreal

Code and dataset for photorealistic Codec Avatars driven from audio

aeneas

aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)

Montreal-Forced-Aligner

Command line utility for forced alignment using Kaldi

SyncTalk

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

deepl-python

Official Python library for the DeepL language translation API.

VideoGPT

PIA

[CVPR 2024] PIA, your Personalized Image Animator. Animate your images by text prompt, combing with Dreambooth, achieving stunning videos. PIA，你的个性化图像动画生成器，利用文本提示将图像变为奇妙的动画

PortaSpeech

PyTorch Implementation of PortaSpeech: Portable and High-Quality Generative Text-to-Speech

espnet_model_zoo

ESPnet Model Zoo

URLExtract

URLExtract is python class for collecting (extracting) URLs from given text based on locating TLD.

LIQE

[CVPR2023] Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective

uroman

Universal Romanizer that can convert any unicode script to roman (latin) script

a3t

Code for paper A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing

DeepForcedAligner

NeMo-speech-data-processor

A toolkit for processing speech data and creating speech datasets

audio-inpainting-diffusion

3aransia

Transliteration for languages and dialects

CQT_pytorch

Pytorch implementation of the invertible CQT based on Non-stationary Gabor filters

TimeStretching

Pytorch implementation of Time Stretching in Music using an Autoencoder Network