TY - GEN
T1 - Hyperspectral and Multi-source Heterogeneous Data Fusion Classification Based on Multiscale Multi-source Interaction Attention Network
AU - Zhang, Biao
AU - Zhang, Mengmeng
AU - Zhang, Yuxiang
AU - Liu, Huan
AU - Guo, Zhengqi
AU - Xie, Xiaoming
AU - Li, Wei
N1 - Publisher Copyright:
© 2024 ACM.
PY - 2024/1/19
Y1 - 2024/1/19
N2 - With the development of remote sensing technology, the performance varies among different sensors, and multi-source data fusion is widely concerned. However, existing methods often fall short in extracting rich features from multi-source data and tend to overlook the mutual complementarity between different data sources. To address this issue, this paper proposes a novel multiscale multi-source attention fusion network. The proposed approach introduces a squeeze-and-excitation convolution module to extract multiscale information and enrich the feature space. An attention mechanism is employed to enhance the importance of relevant spectral features. Additionally, a multi-source interaction attention module is designed to explore the semantic interactions between multiple sources of remote sensing data, thereby improving classification performance. Numerous experiments on two multi-source datasets demonstrate the effectiveness of the suggested approach.
AB - With the development of remote sensing technology, the performance varies among different sensors, and multi-source data fusion is widely concerned. However, existing methods often fall short in extracting rich features from multi-source data and tend to overlook the mutual complementarity between different data sources. To address this issue, this paper proposes a novel multiscale multi-source attention fusion network. The proposed approach introduces a squeeze-and-excitation convolution module to extract multiscale information and enrich the feature space. An attention mechanism is employed to enhance the importance of relevant spectral features. Additionally, a multi-source interaction attention module is designed to explore the semantic interactions between multiple sources of remote sensing data, thereby improving classification performance. Numerous experiments on two multi-source datasets demonstrate the effectiveness of the suggested approach.
KW - Attention module
KW - Complementary effects
KW - Multi-source data
KW - multiscale
KW - Semantic interactions
UR - http://www.scopus.com/inward/record.url?scp=85192710421&partnerID=8YFLogxK
U2 - 10.1145/3647649.3647685
DO - 10.1145/3647649.3647685
M3 - Conference contribution
AN - SCOPUS:85192710421
T3 - ACM International Conference Proceeding Series
SP - 217
EP - 223
BT - ICIGP 2024 - Proceedings of the 2024 7th International Conference on Image and Graphics Processing
PB - Association for Computing Machinery
T2 - 7th International Conference on Image and Graphics Processing, ICIGP 2024
Y2 - 19 January 2024 through 21 January 2024
ER -