fyu / drn

Dilated Residual Networks

Home Page:https://www.vis.xyz/pub/drn

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problems about the test results and the number of categories for Cityscapes

qxr04025 opened this issue · comments

Hi, @fyu ,

Thanks for your code.
When I downloaded the Cityscapes dataset, I found the number of classes is 30, not 19 in the README.md. So I can't reproduce the mAP of the validation set. I am so confused.

And I am also confused about the difference between IOUclass and IOU category in the evaluation for Cityscapes.

Thanks.

Hi @fyu,
The number of labels in Cityscapes dataset is 34 (35 if you include the -1 label of the license plate).
Attached pic is the output of the helper scripts given by Cityscape creators. Link to the script

screenshot from 2017-10-26 04-52-03

Due to this mismatch of the number of labels, the code in which I am running a validation phase spits out the following error when it calculates the loss.
screenshot from 2017-10-26 05-01-06

Please look into this.

The model is trained with 19 labels, i.e. categories with valid trainId, following the official segmentation evaluation protocal of cityscapes.