Skip to main navigation Skip to search Skip to main content

Spatio-Temporal Feature Fusion and Guide Aggregation Network for Remote Sensing Change Detection

  • Hongguang Wei
  • , Nan Wang
  • , Yuan Liu*
  • , Pengge Ma
  • , Dongdong Pang
  • , Xiubao Sui
  • , Qian Chen
  • *Corresponding author for this work
  • Nanjing University of Science and Technology
  • Zhengzhou University of Aeronautics
  • Beijing Information Science & Technology University

Research output: Contribution to journalArticlepeer-review

Abstract

The field of remote sensing change detection (RSCD) has seen significant advancements recently, focusing on the precise identification and analysis of temporal changes in remote sensing images. Existing deep learning-based RSCD methods primarily rely on concatenation or subtraction to integrate features of bi-temporal images and reconstruct change features through a feature pyramid network (FPN) decoding architecture. However, these methods face challenges related to inadequate spatio-temporal change representation and insufficient aggregation of multilevel semantic information, resulting in pseudo-changes and poor completeness of detected change objects. In this article, we propose an innovative RSCD framework via spatio-temporal feature fusion and guide aggregation (STFF-GA) to address the aforementioned challenges. The architecture of this network comprises two key components: the STFF module and the GA module. The STFF module is designed as a low-parameter and low-computation structure, effectively enhancing the representation of spatio-temporal change information through split, interaction, and fusion strategies. The GA module uses deep feature guidance (DFG) mapping as prior information to guide the aggregation of multilevel semantic information, thereby correcting the positional information of change objects and filtering out pseudo-changes and other noise interference. In addition, it utilizes convolution kernels of various scales to extract fine-grained features, facilitating the complete reconstruction of change objects. Extensive experiments conducted on three benchmark change detection datasets demonstrate that the proposed STFF-GA consistently outperforms other state-of-the-art (SOTA) detectors. The code is available at https://github.com/NjustHGWei/STFF-GA.

Original languageEnglish
Article number5642216
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
Publication statusPublished - 2024

Keywords

  • Change detection
  • convolutional neural network (CNN)
  • guide aggregation (GA)
  • spatio-temporal feature fusion (STFF)

Fingerprint

Dive into the research topics of 'Spatio-Temporal Feature Fusion and Guide Aggregation Network for Remote Sensing Change Detection'. Together they form a unique fingerprint.

Cite this