TY - GEN
T1 - A lightweight neural network model for security inspection targets
AU - Zhou, Xiangyin
AU - Qu, Xiujie
AU - Pan, Fanghong
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Although the application of the Yolo-V3 algorithm in target detection has a good performance, it is difficult to deploy the model to mobile platforms such as embedded devices due to the large network model and many redundant parameters. Aiming at the above limitations, this paper proposes a cyclic pruning algorithm based on O-T (Optimal Thresholding) threshold selection, prunes the original Yolo-V3 model, and obtains a lightweight model for security inspection target detection. Firstly, a local sparse strategy is proposed in the sparse training part to make the γ factor on which pruning depends more distinguishable. Secondly, in the threshold selection of the pruning process, the O-T threshold algorithm is introduced to make the selection of the pruning threshold more rational. Finally, in the fine-tuning part, an improved knowledge distillation strategy is proposed to improve the effect of precision recovery. The experimental results show that the pruning algorithm can achieve a higher pruning rate while ensuring a small loss of accuracy, and obtain a more lightweight security inspection target detection model.
AB - Although the application of the Yolo-V3 algorithm in target detection has a good performance, it is difficult to deploy the model to mobile platforms such as embedded devices due to the large network model and many redundant parameters. Aiming at the above limitations, this paper proposes a cyclic pruning algorithm based on O-T (Optimal Thresholding) threshold selection, prunes the original Yolo-V3 model, and obtains a lightweight model for security inspection target detection. Firstly, a local sparse strategy is proposed in the sparse training part to make the γ factor on which pruning depends more distinguishable. Secondly, in the threshold selection of the pruning process, the O-T threshold algorithm is introduced to make the selection of the pruning threshold more rational. Finally, in the fine-tuning part, an improved knowledge distillation strategy is proposed to improve the effect of precision recovery. The experimental results show that the pruning algorithm can achieve a higher pruning rate while ensuring a small loss of accuracy, and obtain a more lightweight security inspection target detection model.
KW - YOLOv3
KW - knowledge distillation
KW - network pruning
KW - sparse training
UR - http://www.scopus.com/inward/record.url?scp=85147674102&partnerID=8YFLogxK
U2 - 10.1109/IMCEC55388.2022.10019899
DO - 10.1109/IMCEC55388.2022.10019899
M3 - Conference contribution
AN - SCOPUS:85147674102
T3 - IMCEC 2022 - IEEE 5th Advanced Information Management, Communicates, Electronic and Automation Control Conference
SP - 270
EP - 275
BT - IMCEC 2022 - IEEE 5th Advanced Information Management, Communicates, Electronic and Automation Control Conference
A2 - Xu, Bing
A2 - Xu, Bing
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 5th IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference, IMCEC 2022
Y2 - 16 December 2022 through 18 December 2022
ER -