TY - GEN
T1 - Lightweight CNN for Radar HRRP Recognition Using NAS-Based Pruning and Multi-Knowledge Distillation
AU - Zhang, Zhilong
AU - Wu, Heke
AU - Xu, Yinhui
AU - Zhang, Liang
AU - Wang, Yanhua
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Deep convolutional neural network (CNN) has been widely studied in radar target high resolution range profile (HRRP) recognition. However, the CNN with deep structure requires high storage and computational capabilities, thus restricting its applications with limited resources. In this paper, we propose a differentiable neural architecture search (NAS)-based channel pruning and multi-knowledge distillation (MKD) to prune and fine-tune the CNN for lightweight. In the pruning stage, NAS method is used to automatically find the good-performance pruning structure by optimizing channel preserve scores. After the search process, these scores are used for global pruning to derive the pruned model. In the fine-tuning stage, MKD method combine the physical scattering knowledge with the category knowledge from pretrained model to restore the pruned model performance. Experimental results on VGG-16 with HRRP dataset inversed from the MSTAR show that the recognition accuracy of the proposed method decreases 1.52% by using 5% model parameters.
AB - Deep convolutional neural network (CNN) has been widely studied in radar target high resolution range profile (HRRP) recognition. However, the CNN with deep structure requires high storage and computational capabilities, thus restricting its applications with limited resources. In this paper, we propose a differentiable neural architecture search (NAS)-based channel pruning and multi-knowledge distillation (MKD) to prune and fine-tune the CNN for lightweight. In the pruning stage, NAS method is used to automatically find the good-performance pruning structure by optimizing channel preserve scores. After the search process, these scores are used for global pruning to derive the pruned model. In the fine-tuning stage, MKD method combine the physical scattering knowledge with the category knowledge from pretrained model to restore the pruned model performance. Experimental results on VGG-16 with HRRP dataset inversed from the MSTAR show that the recognition accuracy of the proposed method decreases 1.52% by using 5% model parameters.
KW - HRRP recognition
KW - channel pruning
KW - convolutional neural network (CNN)
KW - multi-knowledge distillation (MKD)
KW - neural architecture search (NAS)
UR - https://www.scopus.com/pages/publications/86000016586
U2 - 10.1109/ICSIDP62679.2024.10868001
DO - 10.1109/ICSIDP62679.2024.10868001
M3 - Conference contribution
AN - SCOPUS:86000016586
T3 - IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
BT - IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Y2 - 22 November 2024 through 24 November 2024
ER -