Few-shot Remote Sensing Imagery Recognition with Compositionality Inductive Bias in Hierarchical Representation Space

Shichao Zhou, Zhuowei Wang, Zekai Zhang, Wenzheng Wang*, Yingrui Zhao, Yunpu Zhang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Remote sensing scenes from aerial perspective can be constructed by distinct visual parts in a combinatorial number of different ways. Such combinatorial explosion poses great challenges to understanding remote sensing imagery (RSI) with few prior instances (i.e., few-shot RSI recognition). Despite empirical success of existing methods such as data augmentation and knowledge transfer, no large-scale dataset can cover all possible combinations of visual parts. In this case, the prior knowledge learned from these data-driven methods may exhibit dataset bias, resulting in inadequate generalization to the current recognition task. Different from the naive data-driven strategies mentioned above, we alternatively devote to delicate feature modeling by constraining the mapping behavior of deep neural networks. Specifically, we embed inductive bias of compositionality into hierarchical latent representation space, which operates on two aspects: 1) disentangled and reusable representation. We establish a clustering-oriented factorized representation with a mixture model to represent multipart distributions of tokens. Each cluster centroid represents a re-occurring part. New patches are allocated to the nearest cluster centroid, and then we obtain the posterior representation; 2) compositional and discriminative representation. We introduce a hierarchical context prediction mechanism for compositional representation learning, utilizing a predictive NCE loss function to encourage global remote sensing scenes to accurately predict similar local parts, and thus automatically inferring compositional representations of high-level but discriminative latent concepts. Extensive experiments, including comparative experiments with SOTA, sensitivity evaluations, and ablation studies, demonstrate comparable or even superior performance of our method in few-shot RSI recognition.

Original languageEnglish
Pages (from-to)3544-3555
Number of pages12
JournalIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume18
DOIs
Publication statusPublished - 2025

Keywords

  • Clustering methods
  • feature extraction
  • knowledge representation
  • prediction methods
  • remote sensing

Fingerprint

Dive into the research topics of 'Few-shot Remote Sensing Imagery Recognition with Compositionality Inductive Bias in Hierarchical Representation Space'. Together they form a unique fingerprint.

Cite this

Zhou, S., Wang, Z., Zhang, Z., Wang, W., Zhao, Y., & Zhang, Y. (2025). Few-shot Remote Sensing Imagery Recognition with Compositionality Inductive Bias in Hierarchical Representation Space. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 18, 3544-3555. https://doi.org/10.1109/JSTARS.2024.3524573