daifeng2016 / Semantic-Change-Detection

This repository is for semantic change detection.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Semantic-Change-Detection

This is a reporitory for releasing a PyTorch implementation of our work SCDNET: A novel convolutional network for semantic change detection in high resolution optical remote sensing imagery

Introduction

With the continuing improvement of remote-sensing (RS) sensors, it is crucial to monitor Earth surface changes at fne scale and in great detail. Thus, semantic change detection (SCD), which is capable of locating and identifying “from-to” change information simultaneously, is gaining growing attention in RS community. However, due to the limitation of large-scale SCD datasets, most existing SCD methods are focused on scene-level changes, where semantic change maps are generated with only coarse boundary or scarce category information. To address this issue, we propose a novel convolutional network for large-scale SCD (SCDNet). It is based on a Siamese UNet architecture, which consists of two encoders and two decoders with shared weights. First, multi-temporal images are given as input to the encoders to extract multi-scale deep representations. A multi-scale atrous convolution (MAC) unit is inserted at the end of the encoders to enlarge the receptive feld as well as capturing multi-scale information. Then, difference feature maps are generated for each scale, which are combined with feature maps from the encoders to serve as inputs for the decoders. Attention mechanism and deep supervision strategy are further introduced to improve network performance. Finally, we utilize softmax layer to produce a semantic change map for each time image. Extensive experiments are carried out on two large-scale high-resolution SCD datasets, which demonstrates the effectiveness and superiority of the proposed method.

Flowchart

image

Result

image image

Datasets

The two datastes have been uploaded onto Baidu Netdisk, which are available at SCD Datasets Password:rqll

The 2006 images of HRSCD can be found at images_2006

Citation

Please cite our paper if you find it is useful for your research.

@article{peng2021scdnet,
  title={SCDNET: A novel convolutional network for semantic change detection in high resolution optical remote sensing imagery},
  author={Peng, Daifeng and Bruzzone, Lorenzo and Zhang, Yongjun and Guan, Haiyan and He, Pengfei},
  journal={International Journal of Applied Earth Observation and Geoinformation},
  volume={103},
  pages={102465},
  year={2021},
  publisher={Elsevier}
}

About

This repository is for semantic change detection.


Languages

Language:Python 100.0%