d-li14 / PSConv

[ECCV 2020] PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer

Poly-Scale Convolution

Official implementation of our PSConv operator as described in PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer (ECCV'20) by Duo Li, Anbang Yao and Qifeng Chen on the MS COCO 2017 benchmark.

We collect multi-scale feature representations in a finer granularity, by tactfully allocating a spectrum of dilation rates in the kernel lattice.

Getting Started

Installation

Following the instructions from INSTALL.md for installation. More detailed guidance can be found from MMDetection.

Download ImageNet pre-trained checkpoints

Fetch pre-trained weights of PS-ResNet-50, PS-ResNet-101 and PS-ResNeXt-101 (32x4d) backbones and put them to your local path. Set the pretrained path of config file and launch the training of detectors.

Training

The default learning rate in config files is for 8 GPUs and 2 img/GPU (batch size = 8*2 = 16). According to the Linear Scaling Rule, you need to set the learning rate proportional to the batch size if you use different GPUs or images per GPU, e.g., lr=0.01 for 4 GPUs * 2 img/gpu and lr=0.08 for 16 GPUs * 4 img/GPU.

# single-gpu training
python tools/train.py ${CONFIG_FILE}

# multi-gpu training
./tools/dist_train.sh ${CONFIG_FILE} ${GPU_NUM} [optional arguments]

Optional arguments are:

• --validate (strongly recommended): Perform evaluation at every k (default value is 1) epochs during the training.
• --work_dir ${WORK_DIR}: Override the working directory specified in the config file.
• --resume_from ${CHECKPOINT_FILE}: Resume from a previous checkpoint file.

Test

# single-gpu testing
python tools/test.py ${CONFIG_FILE} ${CHECKPOINT_FILE} [--out ${RESULT_FILE}] [--eval ${EVAL_METRICS}] [--show]

# multi-gpu testing
./tools/dist_test.sh ${CONFIG_FILE} ${CHECKPOINT_FILE} ${GPU_NUM} [--out ${RESULT_FILE}] [--eval ${EVAL_METRICS}]

Optional arguments:

• RESULT_FILE: Filename of the output results in pickle format. If not specified, the results will not be saved to a file.
• EVAL_METRICS: Items to be evaluated on the results. Allowed values are: proposal_fast, proposal, bbox, segm, keypoints.
• --show: If specified, detection results will be ploted on the images and shown in a new window. (Only applicable for single GPU testing.)

Model Zoo

Faster R-CNN

Backbone	Style	Lr schd	box AP	Download
R-50-FPN	pytorch	1x	38.4	model | log
R-101-FPN	pytorch	1x	40.9	model | log
X-101-FPN	pytorch	1x	41.3	model | log

Mask R-CNN

Backbone	Style	Lr schd	box AP	mask AP	Download
R-50-FPN	pytorch	1x	39.4	35.6	model | log
R-101-FPN	pytorch	1x	41.6	37.4	model | log
X-101-FPN	pytorch	1x	42.4	38.0	model | log

Cascade R-CNN

Backbone	Style	Lr schd	box AP	Download
R-50-FPN	pytorch	1x	41.9	model | log
R-101-FPN	pytorch	1x	43.8	model | log
X-101-FPN	pytorch	1x	44.4	model | log

Cascade Mask R-CNN

Backbone	Style	Lr schd	box AP	mask AP	Download
R-50-FPN	pytorch	1x	42.9	36.9	model | log
R-101-FPN	pytorch	1x	44.6	38.4	model | log
X-101-FPN	pytorch	1x	45.3	38.9	model | log

Acknowledgement

This implementation is built upon MMDetection. Thanks Kai Chen for releasing this awesome toolbox and his helpful discussions.

Since this project is finished nearly one year ago, we adapt our code from an early commit 713e98b.

Citation

If you find our work useful in your research, please consider citing:

@InProceedings{Li_2020_ECCV,
author = {Li, Duo and Yao, Anbang and Chen, Qifeng},
title = {PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer},
booktitle = {The European Conference on Computer Vision (ECCV)},
month = {August},
year = {2020}
}