Hybrid Transformer Network for Change Detection Under Self-Supervised Pretraining

Yongjing Cui, Yin Zhuang, Shan Dong, Xinyi Zhang, Peng Gao, He Chen*, Liang Chen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper presents a Siamese network architecture based on a multi-scale hybrid convolution-Transformer (CTUNet) for Change Detection (CD) in a pair of co-registered optical remote sensing images. Different form CD frameworks based on convolution neural networks (CNNs) and pure Transformer networks, this method combines a convolution-Transformer hybrid encoder with a multi-scale change information extraction decoder in a Siamese network architecture. It overcomes the inherent limitations of CNN and Transformer and effectively integrates the multi-scale information required for accurate CD. To learn better discriminative representations from various scales, we propose a masked auto-encoder scheme (CTMAE) to adapt to building targets with varying morphological scales, further unleashing the potential of CTUNet. Experiments on two CD datasets show that the proposed self-supervised pre-trained hybrid convolution-Transformer CTUNet architecture achieves better CD performance than previous methods.

Original languageEnglish
Title of host publicationIGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6652-6655
Number of pages4
ISBN (Electronic)9798350320107
DOIs
Publication statusPublished - 2023
Event2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023 - Pasadena, United States
Duration: 16 Jul 202321 Jul 2023

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2023-July

Conference

Conference2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023
Country/TerritoryUnited States
CityPasadena
Period16/07/2321/07/23

Keywords

  • Change detection
  • hybrid convolution-Transformer
  • masked auto-encoder
  • multi-scale fusion
  • remote sensing

Fingerprint

Dive into the research topics of 'Hybrid Transformer Network for Change Detection Under Self-Supervised Pretraining'. Together they form a unique fingerprint.

Cite this