RickyL-2000

CogVideo

Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"

pytorchvideo

A deep learning library for video understanding research.

acad-homepage.github.io

AcadHomepage: A Modern and Responsive Academic Personal Homepage

av-superb

A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)

CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

RectifiedFlow

Official Implementation of Rectified Flow (ICLR2023 Spotlight)

speechmetrics

A wrapper around speech quality metrics MOSNet, BSSEval, STOI, PESQ, SRMR, SISDR

ChatTTS

A generative speech model for daily dialogue.

llama3

The official Meta Llama 3 GitHub site

ROSVOT

Robust Singing Voice Transcription and MIDI Extraction

Prompt-Singer

Implementation of Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt (NAACL'24).

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

parler-tts

Inference and training library for high-quality TTS models.

VideoMAEv2

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

VideoMAE

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

Omost

Your image is almost there!

autochord

Automatic Chord Recognition tools - ISMIR2021 Late-Breaking Demo presentation

MERT

Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".

OpenVoice

Instant voice cloning by MyShell.

WeChatMsg

提取微信聊天记录，将其导出成HTML、Word、Excel文档永久保存，对聊天记录进行分析生成年度聊天报告，用聊天数据训练专属于个人的AI聊天助手

BeatNet

BeatNet is state-of-the-art (Real-Time) and Offline joint music beat, downbeat, tempo, and meter tracking system using CRNN and particle filtering. (ISMIR 2021's paper implementation).

Lyrics-Conditioned-Neural-Melody-Generation

muzic

Muzic: Music Understanding and Generation with Artificial Intelligence

musegan

An AI for Music Generation

audioldm_eval

This toolbox aims to unify audio generation model evaluation for easier comparison.

AudioLDM

AudioLDM: Generate speech, sound effects, music and beyond, with text.

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.