Pixel- and Patch-Wise Context-Aware Learning with CNN and GCN Collaboration for Hyperspectral Image Classification

H. Wang, K. Gao*, X. Zhang, J. Wang, Z. Hu, Z. Yang, Y. Mao, Y. Liu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Graph convolutional network (GCN) gains increasing attention in the hyperspectral image (HSI) classification by the ability to flexibly capture arbitrarily irregular objects. However, due to expensive computation, the graph construction is usually based on superpixel-wise nodes, which ignore the subtle pixel-wise features. In contrast, the convolution neural network (CNN) can mine pixel-wise spectral-spatial features but is limited to capturing local features in small square windows. In this paper, we design a new CNN and GCN collaborative network to simultaneously introduce pixel- and patch-wise contextual information. Concretely, we use the depthwise separable convolution to perform pixel-wise local feature extraction. To further mine the long-range contextual information between land covers, we concatenate a GCN. Finally, we further fuse the complementary features and decode them to obtain the classification map. Extensive experiments reveal that our method achieves competitive performance.

Original languageEnglish
Title of host publicationIGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages7555-7558
Number of pages4
ISBN (Electronic)9798350320107
DOIs
Publication statusPublished - 2023
Event2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023 - Pasadena, United States
Duration: 16 Jul 202321 Jul 2023

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2023-July

Conference

Conference2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023
Country/TerritoryUnited States
CityPasadena
Period16/07/2321/07/23

Keywords

  • CNN and GCN collaboration
  • Hyperspectral image classification
  • context-aware learning
  • pixel- and patch-wise

Fingerprint

Dive into the research topics of 'Pixel- and Patch-Wise Context-Aware Learning with CNN and GCN Collaboration for Hyperspectral Image Classification'. Together they form a unique fingerprint.

Cite this