nkundiushuti

VALL-E-X

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

VoiceCraft

Zero-Shot Speech Editing and Text-to-Speech in the Wild

Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

FasterTransformer

Transformer related optimization, including BERT, GPT

x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

gh-action-pypi-publish

The blessed :octocat: GitHub Action, for publishing your :package: distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish

AcademiCodec

AcademiCodec: An Open Source Audio Codec Model for Academic Research

alpaca_lora_4bit

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

pase

Problem Agnostic Speech Encoder

SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model

vampnet

music generation with masked transformers!

megatts2

Unoffical implementation of Megatts2

SAELens

Training Sparse Autoencoders on Language Models

libfmp

libfmp - Python package for teaching and learning Fundamentals of Music Processing (FMP)

Awesome-VQVAE

📚 A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application

sparse_autoencoder

Sparse Autoencoder for Mechanistic Interpretability

VectorQuantizedCPC

Vector-Quantized Contrastive Predictive Coding for Acoustic Unit Discovery and Voice Conversion

sparse_coding

Using sparse coding to find distributed representations used by neural networks.

LLM-Codec

The open source code for LLM-Codec

encodecmae

Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'

ATST-SED

This repo includes the official implementations of "Fine-tune the pretrained ATST model for sound event detection".

open-universe

Open implementation of UNIVERSE and UNIVERSE++ diffusion-based speech enhancement models.

instruct-MusicGen

The official implementation of our paper "Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning".

vqwordseg

Unsupervised phone and word segmentation using dynamic programming on self-supervised VQ features.

ravel

Evaluate interpretability methods on localizing and disentangling concepts in LLMs.

VocalImitationSet

Open-GPT-4o

pyestimate