cosmoharrigan / entropy-estimation

Estimation of Mutual Information for Image Classification

Home Page:http://www.machineintelligence.org/papers/mutual-information-mnist.pdf

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Estimation of Mutual Information for Image Classification

Author: Cosmo Harrigan

Creates a binarized version of the MNIST dataset and estimates the mutual information between the class label and pixel-level features or the top-k pixel feature vectors

See paper for details: http://www.machineintelligence.org/papers/mutual-information-mnist.pdf

Sample binarized image

Sample digit

Single pixel mutual information

Single pixel mutual information

Top k-pixels mutual information

Top k-pixels mutual information

Prediction accuracy, top k-pixels

Prediction accuracy, top k-pixels

About

Estimation of Mutual Information for Image Classification

http://www.machineintelligence.org/papers/mutual-information-mnist.pdf


Languages

Language:Python 100.0%