Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network

Junjie Wang, Wei Li*, Yunhao Gao, Mengmeng Zhang, Ran Tao, Qian Du

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

94 Citations (Scopus)

Abstract

— Due to the limitations of single-source data, joint classification using multisource remote sensing data has received increasing attention. However, existing methods still have certain shortcomings when faced with feature extraction from single-source data and feature fusion between multisource data. In this article, a method based on multiscale interactive information extraction (MIFNet) for hyperspectral and synthetic aperture radar (SAR) image classification is proposed. First, a multiscale interactive information extraction (MIIE) block is designed to extract meaningful multiscale information. Compared with traditional multiscale models, it can not only obtain richer scale information but also reduce the model parameters and lower the network complexity. Furthermore, a global dependence fusion module (GDFM) is developed to fuse features from multisource data, which implements cross attention between multisource data from a global perspective and captures long-range dependence. Extensive experiments on the three datasets demonstrate the superiority of the proposed method and the necessity of each module for accuracy improvement.

Original languageEnglish
Pages (from-to)10823-10837
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume34
Issue number12
DOIs
Publication statusPublished - 1 Dec 2023

Keywords

  • Global dependence fusion
  • multiscale interactive information extraction (MIIE)
  • multisource remote sensing

Fingerprint

Dive into the research topics of 'Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network'. Together they form a unique fingerprint.

Cite this