adnortje / binet

BINet: a binary inpainting network for patch-based image compression

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

BINet: a binary inpainting network for patch-based image compression

Overview

Recent deep learning models outperform standard lossy image compression codecs. However, applying these models on a patch-by-patch basis requires that each image patch be encoded and decoded independently. The influence from adjacent patches is therefore lost, leading to block artefacts at low bitrates. We propose the Binary Inpainting Network (BINet), an autoencoder framework which incorporates binary inpainting to reinstate interdependencies between adjacent patches, for improved patch-based compression of still images. When decoding a patch, BINet additionally uses the binarised encodings from surrounding patches to guide its reconstruction. In contrast to sequential inpainting methods where patches are decoded based on previons reconstructions, BINet operates directly on the binary codes of surrounding patches without access to the original or reconstructed image data. Encoding and decoding can therefore be performed in parallel. We demonstrate that BINet improves the compression quality of a competitive deep image codec across a range of compression levels. A preprint of our full BINet article is available on arXiv: https://arxiv.org/abs/1912.05189.

Code Status

Please note: This code is currently in a very rough state, i.e. it would be hard to use out-of-the-box. I'll update it and make it more usable in the near future.

License

This code is distributed under the Creative Commons Zero v1.0 Universal license.

About

BINet: a binary inpainting network for patch-based image compression

License:Creative Commons Zero v1.0 Universal


Languages

Language:Jupyter Notebook 97.2%Language:Python 2.8%