hfslyc / FeatureLearning

FeatureLearning-ECCV2016

Unsupervised Visual Representation Learning by Graph-based Consistent Constraints (ECCV 2016)

This is the research code for the paper:

Dong Li, Wei-Chih Hung, Jia-Bin Huang, Shengjin Wang, Narendra Ahuja, and Ming-Hsuan Yang. "Unsupervised Visual Representation Learning by Graph-based Consistent Constraints" In Proceedings of European Conference on Computer Vision (ECCV), 2016

We take the CIFAR10 dataset as an example to test our unsupervised constraint mining approach in this code. Our mined constraints and trained model on ImageNet in the unsupervised manner can be found here:

ImageNet_unsup.zip

Project page

Citation

If you find the code and pre-trained models useful in your research, please consider citing:

@inproceedings{Li-ECCV-2016,
    author = {Li, Dong and Hung, Wei-Chih and Huang, Jia-Bin and Wang, Shengjin and Ahuja, Narendra and Yang, Ming-Hsuan},
    title = {Unsupervised Visual Representation Learning by Graph-based Consistent Constraints},
    booktitle = {European Conference on Computer Vision},
    year = {2016},
    volume = {},
    number = {},
    pages = {}
}

System Requirements

• MATLAB (tested with R2014a on 64-bit Linux)
• Caffe

Installation

1. Download and unzip the project code. Unzip features.zip which is used to extract Fisher Vectors.

2. Download the VLFeat library and extract all the files into the directory named vlfeat. Download the LIBLINEAR library and extract all the files into the directory named liblinear. Install the two dependencies.

3. Install Caffe. Please follow the Caffe installation instructions to install dependencies and then compile Caffe:

   # We call the root directory of the project code `FL_ROOT`.
   cd $FL_ROOT/caffe
   make all -j8
   make pycaffe
   make matcaffe
   

4. Download the CIFAR10 dataset. Extract all the files into $FL_ROOT/datasets/CIFAR10.

5. Download the pre-trained ImageNet model and put it into $FL_ROOT/models.

6. Install the project.

   cd $FL_ROOT
   # Start MATLAB
   matlab
   >> startup
   

Usage

1. Extract low-level features (Fisher Vectors).

   >> prepare_data
   >> extract_features
   

2. Mine constraints.

   >> extract_pairs_pos
   >> extract_pairs_neg
   

3. Train the Siamese network for binary classification.

   >> prepare_train
   cd $FL_ROOT
   sh train.sh
   

4. Test for image classification.

   >> test_cifar