DECOR: Dynamic Decoupling and Multiobjective Optimization for Long-Tailed Remote Sensing Image Classification

Jianlin Xie, Guanqun Wang*, Yin Zhuang, Can Li, Tong Zhang, He Chen, Liang Chen, Shanghang Zhang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

In the realm of remote sensing, targets of interest span a range of categories. However, their distribution is not always uniform. Certain categories substantially outnumber others, resulting in what's termed a 'long-Tailed distribution' in remote sensing imagery. This imbalanced distribution often biases a classifier's focus toward the more abundant (head) classes, at the detriment of the less-represented (tail) classes. Such biases undermine the classifier's generalization performance, particularly in the context of remote sensing image classification (RSIC). While existing mitigation approaches such as resampling, reweighting, and transfer learning offer some respite, they often miss out on in-depth knowledge refinement, rendering them less effective for severe long-Tailed RSIC scenarios. To counter these challenges, we introduce DECOR, a dynamic decoupling (DD) and multiobjective optimization framework (MOOF). Within DECOR, the feature extractor and classifier are dynamically decoupled, promoting superior feature representation and classifier training. Then, a multiobjective optimization approach is proposed to delve deeper, refining feature representation at the knowledge level using learnable feature centroids (LFCs) coupled with masked world knowledge learning (WKL). Moreover, to combat the pronounced effects of sample imbalance on classifier training, we employ a class-balanced resampling technique paired with a parameter-efficient adapter, which sharpens the classifier's decision boundary and bridges the gap between representation and classification. DECOR's efficacy is validated through comprehensive experiments on several datasets, including the NWPU-RESISC45-LT (NWPU-LT), AID-LT, and our self-built BIT-AFGR50-LT. Experimental results demonstrate DECOR's marked enhancement in performance on long-Tailed datasets. Our source code is available at: https://github.com/ChloeeGrace/DECOR.

Original languageEnglish
Article number5612517
Pages (from-to)1-17
Number of pages17
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
Publication statusPublished - 2024

Keywords

  • Decouple learning
  • long tail
  • remote sensing scene classification

Fingerprint

Dive into the research topics of 'DECOR: Dynamic Decoupling and Multiobjective Optimization for Long-Tailed Remote Sensing Image Classification'. Together they form a unique fingerprint.

Cite this