TY - JOUR
T1 - DECOR
T2 - Dynamic Decoupling and Multiobjective Optimization for Long-Tailed Remote Sensing Image Classification
AU - Xie, Jianlin
AU - Wang, Guanqun
AU - Zhuang, Yin
AU - Li, Can
AU - Zhang, Tong
AU - Chen, He
AU - Chen, Liang
AU - Zhang, Shanghang
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2024
Y1 - 2024
N2 - In the realm of remote sensing, targets of interest span a range of categories. However, their distribution is not always uniform. Certain categories substantially outnumber others, resulting in what's termed a 'long-Tailed distribution' in remote sensing imagery. This imbalanced distribution often biases a classifier's focus toward the more abundant (head) classes, at the detriment of the less-represented (tail) classes. Such biases undermine the classifier's generalization performance, particularly in the context of remote sensing image classification (RSIC). While existing mitigation approaches such as resampling, reweighting, and transfer learning offer some respite, they often miss out on in-depth knowledge refinement, rendering them less effective for severe long-Tailed RSIC scenarios. To counter these challenges, we introduce DECOR, a dynamic decoupling (DD) and multiobjective optimization framework (MOOF). Within DECOR, the feature extractor and classifier are dynamically decoupled, promoting superior feature representation and classifier training. Then, a multiobjective optimization approach is proposed to delve deeper, refining feature representation at the knowledge level using learnable feature centroids (LFCs) coupled with masked world knowledge learning (WKL). Moreover, to combat the pronounced effects of sample imbalance on classifier training, we employ a class-balanced resampling technique paired with a parameter-efficient adapter, which sharpens the classifier's decision boundary and bridges the gap between representation and classification. DECOR's efficacy is validated through comprehensive experiments on several datasets, including the NWPU-RESISC45-LT (NWPU-LT), AID-LT, and our self-built BIT-AFGR50-LT. Experimental results demonstrate DECOR's marked enhancement in performance on long-Tailed datasets. Our source code is available at: https://github.com/ChloeeGrace/DECOR.
AB - In the realm of remote sensing, targets of interest span a range of categories. However, their distribution is not always uniform. Certain categories substantially outnumber others, resulting in what's termed a 'long-Tailed distribution' in remote sensing imagery. This imbalanced distribution often biases a classifier's focus toward the more abundant (head) classes, at the detriment of the less-represented (tail) classes. Such biases undermine the classifier's generalization performance, particularly in the context of remote sensing image classification (RSIC). While existing mitigation approaches such as resampling, reweighting, and transfer learning offer some respite, they often miss out on in-depth knowledge refinement, rendering them less effective for severe long-Tailed RSIC scenarios. To counter these challenges, we introduce DECOR, a dynamic decoupling (DD) and multiobjective optimization framework (MOOF). Within DECOR, the feature extractor and classifier are dynamically decoupled, promoting superior feature representation and classifier training. Then, a multiobjective optimization approach is proposed to delve deeper, refining feature representation at the knowledge level using learnable feature centroids (LFCs) coupled with masked world knowledge learning (WKL). Moreover, to combat the pronounced effects of sample imbalance on classifier training, we employ a class-balanced resampling technique paired with a parameter-efficient adapter, which sharpens the classifier's decision boundary and bridges the gap between representation and classification. DECOR's efficacy is validated through comprehensive experiments on several datasets, including the NWPU-RESISC45-LT (NWPU-LT), AID-LT, and our self-built BIT-AFGR50-LT. Experimental results demonstrate DECOR's marked enhancement in performance on long-Tailed datasets. Our source code is available at: https://github.com/ChloeeGrace/DECOR.
KW - Decouple learning
KW - long tail
KW - remote sensing scene classification
UR - http://www.scopus.com/inward/record.url?scp=85186097447&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2024.3369178
DO - 10.1109/TGRS.2024.3369178
M3 - Article
AN - SCOPUS:85186097447
SN - 0196-2892
VL - 62
SP - 1
EP - 17
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5612517
ER -