vivjay30 / pnf-sampling

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamics

Audio Super Resolution

Authors

Vivek Jayaram*, John Thickstun*
*Equal Contribution
University of Washington

Video and audio demos are available at the project page

Paper (Coming Soon)

The Thirty-eighth International Conference on Machine Learning, ICML 2021.

Summary

We propose a new way to sample from autoregressive models by smoothing the distribution and using the gradients of the likelihood. This allows flexible conditional sampling, and also allows us to parallelize the sampling process. We apply these techniques in the visual and audio domains, with competitive results for audio source separation, super-resolution, and inpainting.

Instructions

There are two subdirectories, one for audio experiments using a wavenet model and one for small scale image experiments using a pixelcnn++ model. Each directory is independent and contains a Readme for specific running instructions.


Image Inpainting

About

License:MIT License


Languages

Language:Python 100.0%