entn-at

SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model

LookOnceToHear

A novel human-interaction method for real-time speech extraction on headphones.

lina-speech

lina-speech : linear attention based text-to-speech

multilingual-distilwhisper

This repository contains all the code necessary for running the multilingual distilwhisper from Ferraz et al. 2024 IEEE ICASSP paper.

MMCSG

This repository contains the baseline system for CHiME-8 MMCSG challenge focusing on transcribing both sides of a conversation where one participant is wearing smart glasses equipped with a microphone array and camera.

SECap

ml-sigma-reparam

mamba

Mamba SSM architecture

stopes

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

UltraFastBERT

The repository for the code of the UltraFastBERT paper

flash-fft-conv

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

ml-nvas3d

intel-mkl-src

Redistribute Intel MKL as a crate

open-interpreter

A natural language interface for computers

fairseq2

FAIR Sequence Modeling Toolkit 2

NISQA

NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment

kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

SwiftWhisper

🎤 The easiest way to transcribe audio in Swift

synjax

whisper-burn

A Rust implementation of OpenAI's Whisper model using the burn framework

RetNet

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"

FineGrainedRLHF

WavText5K

Web-crawl for "Audio Retrieval with WavText5K and CLAP Training"

hamt

A hash array-mapped trie implementation in C

LLM-Training-Puzzles

What would you do with 1000 H100s...

ContrastiveDecoding

contrastive decoding

vampnet

music generation with masked transformers!

Diff-TTSG

Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis

whisper_streaming

Whisper realtime streaming for long speech-to-text transcription and translation

Scyclone

Real-time Neural Timbre Transfer