Implementation of ICLR 2017 paper "Loss aware Binarization of Deep Networks", tested with GTX TITAN X, python 2.7, theano 0.9.0 and lasagne 0.2.dev1.
This repository is divided in two subrepositories:
-
FNN: enables the reproduction of the FNN results(on MNIST, CIFAR-10, SVHN)reported in the article
-
RNN: enables the reproduction of the RNN results(on War and Peace, Linux Kernel) reported in the article
Requirements This software is implemented on top of the implementation of BinaryConnect and has all the same requirements.
Example training command on War and Peace dataset:
- training LAB
python warpeace.py --method="LAB" --lr_start=0.002 --w="w" --len=100- training LAB2
python warpeace.py --method="LAB" --lr_start=0.002 --w="wa" --len=100