KiAlexander

google-research

Google Research

tinygrad

You like pytorch? You like micrograd? You love tinygrad! ❤️

speechbrain

A PyTorch-based Speech Toolkit

lip-reading-deeplearning

:unlock: Lip Reading - Cross Audio-Visual Recognition using 3D Architectures

hifi-gan

HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

denoiser

Real Time Speech Enhancement in the Waveform Domain (Interspeech 2020)We provide a PyTorch implementation of the paper Real Time Speech Enhancement in the Waveform Domain. In which, we present a causal speech enhancement model working on the raw waveform that runs in real-time on a laptop CPU. The proposed model is based on an encoder-decoder architecture with skip-connections. It is optimized on both time and frequency domains, using multiple loss functions. Empirical evidence shows that it is capable of removing various kinds of background noise including stationary and non-stationary noises, as well as room reverb. Additionally, we suggest a set of data augmentation techniques applied directly on the raw waveform which further improve model performance and its generalization abilities.

packnet-sfm

TRI-ML Monocular Depth Estimation Repository

k2

FSA/FST algorithms, differentiable, with PyTorch compatibility.

Res2Net-PretrainedModels

(ImageNet pretrained models) The official pytorch implemention of the TPAMI paper "Res2Net: A New Multi-scale Backbone Architecture"

audino

Open source audio annotation tool for humans

lhotse

Tools for handling speech data in machine learning projects.

transformer

Implementation of Transformer model (originally from Attention is All You Need) applied to Time Series.

Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

open-aff

code and trained models for "Attentional Feature Fusion"

transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

Lipreading_using_Temporal_Convolutional_Networks

ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASSP'20 Lipreading using Temporal Convolutional Networks

pika

a lightweight speech processing toolkit based on Pytorch and (Py)Kaldi

pystoi

Python implementation of the Short Term Objective Intelligibility measure

torchsummaryX

torchsummaryX: Improved visualization tool of torchsummary

MMAL-Net

This is a PyTorch implementation of the paper "Multi-branch and Multi-scale Attention Learning for Fine-Grained Visual Categorization (MMAL-Net)" (Fan Zhang, Meng Li, Guisheng Zhai, Yizhao Liu).

Multi-Scale-1D-ResNet

pytorch code of multi scale 1d resnet, we hope it will help your research

avobjects

Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"

DPTNet

ConferencingSpeech2021

Conferencing Speech Challenge

active-speakers-context

Code for the Active Speakers in Context Paper (CVPR2020)

GC3

pytorch_complex

A temporal module for PyTorch-ComplexTensor

gan-torch

gan_torch (cpu & gpu)

biased_separation

Code for the paper: Unified Gradient Reweighting for Model Biasing with Applications to Source Separation

mediaio