sithu31296 / semantic-segmentation

SOTA Semantic Segmentation Models in PyTorch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Double Checking implementation detail in SegFormerHead

RahulSinghalChicago opened this issue · comments

The paper on SegFormer suggests an All MLP decoder.

Screen Shot 2022-04-23 at 3 03 57 AM

The SegformerHead.py shows the use of a Conv2D for the final layer.

Screen Shot 2022-04-23 at 3 06 18 AM

Can you help me understand if this is a deviation from the paper or mentioned in a followup paper somewhere? I apologize in advance if there is an obvious answer.

1x1 conv is basically the same as linear operation. In segmentation, 1x1 conv is usually used as the last layer. You can also check the official segformer implementation.

Thank you!