Fine-tune Convolutional Neural Network in Keras with ImageNet Pretrained Models

The reason to create this repo is that there are not many online resources that provide sample codes for performing fine-tuning, and that there is not a centralized place where we can easily download ImageNet pretrained models for common ConvNet architectures such as VGG, Inception, ResNet, and DenseNet. This repo serves to fill this gap by providing working examples of fine-tuning on Cifar10 dataset with ImageNet pretrained models on popular ConvNet implementations.

See this for a comprehensive treatment of fine-tuning Deep Learning Models in Keras

Usage

For illustration purpose, let's say you want to perform fine-tuning with VGG-16. First, download the ImageNet pretrained weights for VGG-16 to the imagenet_models directory. The schema and sample code for fine-tuning on Cifar10 can be found in vgg16.py. Run the file:

python vgg16.py

The code will automatically download Cifar10 dataset and performs fine-tuning with VGG-16. Please be aware that it might take some time (up to minutes) for the model to compile and load the ImageNet weights.

Finetune with your own dataset

If you wish to perform fine-tuning on your own dataset, you have to replace the module which loads the Cifar10 dataset with your own load_data() module to load your own dataset.

X_train, Y_train, X_valid, Y_valid = load_data()

In particular, the following image preprocessing step have to be performed to get the format of the dataset compatible with the pretrained models:

# For Tensorflow 
# Switch RGB to BGR order 
x = x[:, :, :, ::-1]  

# Subtract ImageNet mean pixel 
x[:, :, :, 0] -= 103.939
x[:, :, :, 1] -= 116.779
x[:, :, :, 2] -= 123.68

# For Theano
# Switch RGB to BGR order 
x = x[:, ::-1, :, :]

# Subtract ImageNet mean pixel 
x[:, 0, :, :] -= 103.939
x[:, 1, :, :] -= 116.779
x[:, 2, :, :] -= 123.68

ImageNet Pretrained Models

Network	Theano	Tensorflow
VGG-16	model (553 MB)	-
VGG-19	model (575 MB)	-
GoogLeNet (Inception-V1)	model (54 MB)	-
Inception-V3	model (95 MB)	-
Inception-V4	model (172 MB)	model (172 MB)
ResNet-50	model (103 MB)	model (103 MB)
ResNet-101	model (179 MB)	model (179 MB)
ResNet-152	model (243 MB)	model (243 MB)
DenseNet-121	model (32 MB)	model (32 MB)
DenseNet-169	model (56 MB)	model (56 MB)
DenseNet-161	model (112 MB)	model (112 MB)

Requirements

Keras ~~1.2.2~~ 2.0.5
Theano 0.8.2 or TensorFlow ~~0.12.0~~ 1.2.1

Updates

Keras 2.0.5 and TensorFlow 1.2.1 are supported

getway / cnn_finetune