Hyperspectral and Multi-source Heterogeneous Data Fusion Classification Based on Multiscale Multi-source Interaction Attention Network

Biao Zhang, Mengmeng Zhang, Yuxiang Zhang, Huan Liu, Zhengqi Guo, Xiaoming Xie*, Wei Li

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the development of remote sensing technology, the performance varies among different sensors, and multi-source data fusion is widely concerned. However, existing methods often fall short in extracting rich features from multi-source data and tend to overlook the mutual complementarity between different data sources. To address this issue, this paper proposes a novel multiscale multi-source attention fusion network. The proposed approach introduces a squeeze-and-excitation convolution module to extract multiscale information and enrich the feature space. An attention mechanism is employed to enhance the importance of relevant spectral features. Additionally, a multi-source interaction attention module is designed to explore the semantic interactions between multiple sources of remote sensing data, thereby improving classification performance. Numerous experiments on two multi-source datasets demonstrate the effectiveness of the suggested approach.

Original languageEnglish
Title of host publicationICIGP 2024 - Proceedings of the 2024 7th International Conference on Image and Graphics Processing
PublisherAssociation for Computing Machinery
Pages217-223
Number of pages7
ISBN (Electronic)9798400716720
DOIs
Publication statusPublished - 19 Jan 2024
Event7th International Conference on Image and Graphics Processing, ICIGP 2024 - Beijing, China
Duration: 19 Jan 202421 Jan 2024

Publication series

NameACM International Conference Proceeding Series

Conference

Conference7th International Conference on Image and Graphics Processing, ICIGP 2024
Country/TerritoryChina
CityBeijing
Period19/01/2421/01/24

Keywords

  • Attention module
  • Complementary effects
  • Multi-source data
  • multiscale
  • Semantic interactions

Fingerprint

Dive into the research topics of 'Hyperspectral and Multi-source Heterogeneous Data Fusion Classification Based on Multiscale Multi-source Interaction Attention Network'. Together they form a unique fingerprint.

Cite this