MSTCA-Net: A Novel Impervious Surface Extraction Method Based on a Multistage Transformer

Xiaohua Wan, Wenjing Zhang, Dehui Qiu, Sijia Li, Fa Zhang*, Zhongchang Sun*, Bin Hu*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

The area of impervious surfaces serves as a critical metric to gauge urbanization levels and evaluates ecological health in a given region. However, in some areas with low-density impervious surfaces, these impervious surfaces are often small in size and distributed scatteredly, making them easily mistaken for the background. Therefore, accurately extracting these small and scattered impervious surfaces remains a significant challenge. In our previous work, TCA-Net pioneered the application of transformers for extracting impervious surfaces. However, owing to the limitations of transformers, TCA-Net struggled to precisely identify small, scattered impervious surfaces. In many cases, some minor roads extracted are discontinuous and incomplete. To enhance the transformer's performance in extracting impervious surfaces, we introduce MSTCA-Net, a dual-branch network. MSTCA-Net incorporates a multiscale transformer that preserves local details while capturing global context, and a Unet branch augmented with a coordinate attention mechanism, which captures intricate details while minimizing information redundancy. Experimental results show that MSTCA-Net proposed in this work can greatly outperform the traditional CNN models and our previous work, especially in extracting small and scattered impervious surfaces.

Original languageEnglish
Pages (from-to)17945-17956
Number of pages12
JournalIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume17
DOIs
Publication statusPublished - 2024

Keywords

  • Coordinate attention
  • impervious surface extraction
  • semantic segmentation
  • transformer

Fingerprint

Dive into the research topics of 'MSTCA-Net: A Novel Impervious Surface Extraction Method Based on a Multistage Transformer'. Together they form a unique fingerprint.

Cite this