TY - JOUR
T1 - Decoupling-Based Cross-Layer Connection Removal for Compact Remote Sensing Image Classification
AU - Deng, Zhiyuan
AU - Han, Yuqi
AU - Wang, Wenzheng
AU - Deng, Chenwei
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Cross-layer connections can couple different layers of neural networks in diverse paths, improving the classification accuracy of remote sensing images. However, some structures are unnecessary for inference and not conducive to be deployed on starboard/airborne platforms. Roughly removing them lengthens the backpropagation path and causes the gradient vanishing problem, degrading the performance of existing end-to-end training-based lightweighting methods. To address this issue, we propose a decoupling-based cross-layer connection removal (DCCR) framework, which decomposes the complete deep network into multiple shallower stages based on the density of connections. By optimizing each stage independently, the backpropagation path is shortened and the gradient vanishing problem is expected to be alleviated. Moreover, to approximate the original network in each stage, we perform concrete reconstruction error suppression on branches, layers, and channels. Combining these strategies, redundant structures are removed while maintaining performance. Extensive experiments on multiple public datasets and hardware platforms demonstrate that this compact architecture achieves substantially improved deployability and inference efficiency at the cost of only marginal accuracy degradation.
AB - Cross-layer connections can couple different layers of neural networks in diverse paths, improving the classification accuracy of remote sensing images. However, some structures are unnecessary for inference and not conducive to be deployed on starboard/airborne platforms. Roughly removing them lengthens the backpropagation path and causes the gradient vanishing problem, degrading the performance of existing end-to-end training-based lightweighting methods. To address this issue, we propose a decoupling-based cross-layer connection removal (DCCR) framework, which decomposes the complete deep network into multiple shallower stages based on the density of connections. By optimizing each stage independently, the backpropagation path is shortened and the gradient vanishing problem is expected to be alleviated. Moreover, to approximate the original network in each stage, we perform concrete reconstruction error suppression on branches, layers, and channels. Combining these strategies, redundant structures are removed while maintaining performance. Extensive experiments on multiple public datasets and hardware platforms demonstrate that this compact architecture achieves substantially improved deployability and inference efficiency at the cost of only marginal accuracy degradation.
KW - Cross-layer connection
KW - decoupling
KW - model compression
KW - multibranch neural network
KW - reconstruction
KW - remote sensing image classification
UR - https://www.scopus.com/pages/publications/105023127204
U2 - 10.1109/TGRS.2025.3636678
DO - 10.1109/TGRS.2025.3636678
M3 - Article
AN - SCOPUS:105023127204
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5655216
ER -