WhiteFu's repositories
ai-audio-startups
Community list of startups working with AI in audio and music technology
awesome-audio-plaza
Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation
Awesome-LLMs-Datasets
Summarize existing representative LLMs text datasets.
Awesome-LLMs-meet-Multimodal-Generation
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
Bunny
A family of lightweight multimodal models.
ConsistI2V
ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation
EVA
EVA Series: Visual Representation Fantasies from BAAI
FRESCO
[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation
languagecodec
Official code repository of Language-Codec
lina-speech
lina-speech : linear attention based text-to-speech
M2UGen
This is the official repository for M2UGen
Mantis
Official code for Paper "Mantis: Multi-Image Instruction Tuning"
metavoice-src
Foundational model for human-like, expressive TTS
MoneyPrinterTurbo
利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.
Open-Sora
Building your own video generation model like OpenAI's Sora
OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
pyvideotrans
Translate the video from one language to another and add dubbing. 将视频从一种语言翻译为另一种语言，并添加配音
snac
Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate
SoraReview
The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".
transcribe-anything
Input a local file or url and this service will transcribe it using Whisper AI. Completely private and Free 🤯🤯🤯
VoiceCraft
Zero-Shot Speech Editing and Text-to-Speech in the Wild
youtube-transcript-api
This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!