zsc

ChatTTS

A generative speech model for daily dialogue.

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

Scrapegraph-ai

Python scraper based on AI

EmotiVoice

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine

WhisperSpeech

An Open Source text-to-speech system built by inverting Whisper.

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

voice_datasets

🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).

WhisperLive

A nearly-live implementation of OpenAI's Whisper.

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

ml-4m

4M: Massively Multimodal Masked Modeling

Memary

The Memory Layer For Autonomous Agents

soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

suno-api

Use API to call the music generation AI of suno.ai, and easily integrate it into agents like GPTs.

PuLID

Official code for PuLID: Pure and Lightning ID Customization via Contrastive Alignment

improved-aesthetic-predictor

CLIP+MLP Aesthetic Score Predictor

megactor

ai-audio-datasets

AI Audio Datasets (AI-ADS) 🎵, including Speech, Music, and Sound Effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications.

AEC-Challenge

AEC Challenge

CraftsMan

CraftsMan: High-fidelity Mesh Generation with 3D Native Diffusion and Interactive Geometry Refiner

ScreenAI

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

lightplane

Lightplane implements a highly memory-efficient differentiable radiance field renderer, and a module for unprojecting features from images to 3D grids.

TokenHMR

[CVPR 2024] TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation

libriheavy

Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context

Assemble-Them-All

[SIGGRAPH Asia 2022] Assemble Them All: Physics-Based Planning for Generalizable Assembly by Disassembly

TalkingHead-1KH

get-haized

A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.

myo_sim

Musculoskeletal Models in MuJoCo

dreambench_plus

pinyin-to-ipa

Command-line interface and Python library to transcribe pinyin to IPA. The tones are attached to the vowel of the syllable.

demucs_batch-multigpu

[Batching/MultiGPU/DataLoader Implemented] Code for the paper Hybrid Spectrogram and Waveform Source Separation