MFA-SCDNet: A Semantic Change Detection Network for Visible and Infrared Image Pairs

  • Xingyu Li
  • , Jiulu Gong
  • , Jianxiong Wen
  • , Zepeng Wang*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Semantic Change Detection (SCD) in remote sensing imagery is a common technique for monitoring surface dynamics. However, geospatial data acquisition increasingly involves the collection of visible and infrared images. SCD in visible and infrared image pairs confronts the challenge of distinguishing genuine semantic change from spectral discrepancies caused by heterogeneous imaging mechanisms. To address this issue, we propose a Modal Feature Analysis Semantic Change Detection Network (MFA-SCDNet), a novel framework that analyzes cross-modal features for change identification. The proposed architecture operates through three principal technical components: An infrared feature enhancement module that transforms infrared inputs into three-channel representations through spectral domain adaptation, enhancing the network’s perception of both high-frequency and low-frequency information in images; an encoder–decoder structure that simultaneously extracts modality-specific features and common features through adversarial learning; and a synergistic information fusion mechanism that integrates semantic recognition with change detection through multi-task optimization. Specific features are employed for semantic recognition, while common features are utilized for change detection, ultimately resulting in a comprehensive understanding of semantic changes. Experiments on public datasets show that MFA-SCDNet has an average improvement of 9.4% in mIoUbc and 12.9% in mIoUsc compared with the alternatives. MFA-SCDNet has better performance in heterogeneous images SCD.

Original languageEnglish
Article number2011
JournalRemote Sensing
Volume17
Issue number12
DOIs
Publication statusPublished - Jun 2025
Externally publishedYes

Keywords

  • adversarial training
  • feature extraction
  • heterogeneous images
  • semantic change detection

Fingerprint

Dive into the research topics of 'MFA-SCDNet: A Semantic Change Detection Network for Visible and Infrared Image Pairs'. Together they form a unique fingerprint.

Cite this