TY - JOUR
T1 - MSTCA-Net
T2 - A Novel Impervious Surface Extraction Method Based on a Multistage Transformer
AU - Wan, Xiaohua
AU - Zhang, Wenjing
AU - Qiu, Dehui
AU - Li, Sijia
AU - Zhang, Fa
AU - Sun, Zhongchang
AU - Hu, Bin
N1 - Publisher Copyright:
© 2024 The Authors.
PY - 2024
Y1 - 2024
N2 - The area of impervious surfaces serves as a critical metric to gauge urbanization levels and evaluates ecological health in a given region. However, in some areas with low-density impervious surfaces, these impervious surfaces are often small in size and distributed scatteredly, making them easily mistaken for the background. Therefore, accurately extracting these small and scattered impervious surfaces remains a significant challenge. In our previous work, TCA-Net pioneered the application of transformers for extracting impervious surfaces. However, owing to the limitations of transformers, TCA-Net struggled to precisely identify small, scattered impervious surfaces. In many cases, some minor roads extracted are discontinuous and incomplete. To enhance the transformer's performance in extracting impervious surfaces, we introduce MSTCA-Net, a dual-branch network. MSTCA-Net incorporates a multiscale transformer that preserves local details while capturing global context, and a Unet branch augmented with a coordinate attention mechanism, which captures intricate details while minimizing information redundancy. Experimental results show that MSTCA-Net proposed in this work can greatly outperform the traditional CNN models and our previous work, especially in extracting small and scattered impervious surfaces.
AB - The area of impervious surfaces serves as a critical metric to gauge urbanization levels and evaluates ecological health in a given region. However, in some areas with low-density impervious surfaces, these impervious surfaces are often small in size and distributed scatteredly, making them easily mistaken for the background. Therefore, accurately extracting these small and scattered impervious surfaces remains a significant challenge. In our previous work, TCA-Net pioneered the application of transformers for extracting impervious surfaces. However, owing to the limitations of transformers, TCA-Net struggled to precisely identify small, scattered impervious surfaces. In many cases, some minor roads extracted are discontinuous and incomplete. To enhance the transformer's performance in extracting impervious surfaces, we introduce MSTCA-Net, a dual-branch network. MSTCA-Net incorporates a multiscale transformer that preserves local details while capturing global context, and a Unet branch augmented with a coordinate attention mechanism, which captures intricate details while minimizing information redundancy. Experimental results show that MSTCA-Net proposed in this work can greatly outperform the traditional CNN models and our previous work, especially in extracting small and scattered impervious surfaces.
KW - Coordinate attention
KW - impervious surface extraction
KW - semantic segmentation
KW - transformer
UR - http://www.scopus.com/inward/record.url?scp=85205457810&partnerID=8YFLogxK
U2 - 10.1109/JSTARS.2024.3469239
DO - 10.1109/JSTARS.2024.3469239
M3 - Article
AN - SCOPUS:85205457810
SN - 1939-1404
VL - 17
SP - 17945
EP - 17956
JO - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
JF - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
ER -