TY - JOUR
T1 - 轻量级多任务的苹果成熟度分类模型(特邀)
AU - Zhang, Li
AU - Wang, Xiaoge
AU - Bao, Chun
AU - Cao, Jie
AU - Hao, Qun
N1 - Publisher Copyright:
© 2024 Universitat zu Koln. All rights reserved.
PY - 2024/10
Y1 - 2024/10
N2 - The maturity level and appearance defects of apples are crucial criteria for determining their quality. To automate the removal of immature and defective apples in picking tasks, a lightweight multi-task maturity classification model (L-MTCNN) is proposed. This model comprises two sub networks, D-Net and M-Net, for multi-task classification of apple appearance defects and maturity level. Furthermore, it uses a backbone network to extract feature information, which is then applied to D-Net and M-Net, thereby improving feature utilization and reducing overall recognition computation time. Introducing Triplet loss as the loss function for M-Net increases the separation between different maturity levels while reducing the variance within the same level. Additionally, based on industry standards, the study examines the appearance changes in various apple ripening processes and constructs an apple maturity dataset. A brightness-based color restoration algorithm is proposed to address the inconsistencies between collected apple images and their actual appearance, caused by varying lighting conditions during image acquisition. This algorithm restores the color restoration of the collected images and facilitates the creation of a reliable on apple maturity dataset. Experimental results indicate that D-Net and M-Net substantially improve average accuracy compared to AlexNet, ResNet18, ResNet34, and VGG16. Furthermore, in terms of recall rate, precision rate, and F1 score, the proposed model outperforms existing models in classifying maturity levels and defect statuses. This demonstrates that the model can achieve high-accuracy maturity level judgments for different types of apples, providing valuable insights for developing integrated operation robots.
AB - The maturity level and appearance defects of apples are crucial criteria for determining their quality. To automate the removal of immature and defective apples in picking tasks, a lightweight multi-task maturity classification model (L-MTCNN) is proposed. This model comprises two sub networks, D-Net and M-Net, for multi-task classification of apple appearance defects and maturity level. Furthermore, it uses a backbone network to extract feature information, which is then applied to D-Net and M-Net, thereby improving feature utilization and reducing overall recognition computation time. Introducing Triplet loss as the loss function for M-Net increases the separation between different maturity levels while reducing the variance within the same level. Additionally, based on industry standards, the study examines the appearance changes in various apple ripening processes and constructs an apple maturity dataset. A brightness-based color restoration algorithm is proposed to address the inconsistencies between collected apple images and their actual appearance, caused by varying lighting conditions during image acquisition. This algorithm restores the color restoration of the collected images and facilitates the creation of a reliable on apple maturity dataset. Experimental results indicate that D-Net and M-Net substantially improve average accuracy compared to AlexNet, ResNet18, ResNet34, and VGG16. Furthermore, in terms of recall rate, precision rate, and F1 score, the proposed model outperforms existing models in classifying maturity levels and defect statuses. This demonstrates that the model can achieve high-accuracy maturity level judgments for different types of apples, providing valuable insights for developing integrated operation robots.
KW - convolutional neural network
KW - fruit quality
KW - lightweight
KW - maturity classification
KW - multitask
UR - http://www.scopus.com/inward/record.url?scp=85217956331&partnerID=8YFLogxK
U2 - 10.3788/LOP240953
DO - 10.3788/LOP240953
M3 - 文章
AN - SCOPUS:85217956331
SN - 1006-4125
VL - 61
JO - Laser and Optoelectronics Progress
JF - Laser and Optoelectronics Progress
IS - 20
M1 - 2011012
ER -