TY - JOUR
T1 - An automated optical inspection (AOI) platform for three-dimensional (3D) defects detection on glass micro-optical components (GMOC)
AU - Du, Yinchao
AU - Chen, Jiangpeng
AU - Zhou, Han
AU - Yang, Xiaoling
AU - Wang, Zhongqi
AU - Zhang, Jie
AU - Shi, Yuechun
AU - Chen, Xiangfei
AU - Zheng, Xuezhe
N1 - Publisher Copyright:
© 2023 The Author(s)
PY - 2023/10/15
Y1 - 2023/10/15
N2 - With the widespread deployment of wavelength division multiplexing (WDM), optical transceivers increasingly use many glass micro-optical components (GMOC). Visual inspection of these GMOCs is a critical manufacturing step to ensure quality and reliability. However, manual inspection is often labor-intensive and time-consuming due to the transparent nature of glass components and the small, randomly located defects in three dimensions. Although automated optical inspection (AOI) exists, it has not yet been able to provide the desired level of accuracy and efficiency. This paper reports the development of an AOI platform for 3D defect detection on GMOCs. The platform incorporates 3D video acquisition and a novel two-stage neural network machine-learning algorithm. It includes a robotic arm for moving parts in 3D, a camera with an illumination module for video acquisition, and a video streaming processing unit with a machine vision algorithm for real-time defect detection on a production line. The robotic arm enables multi-perspective video capture of a test sample without refocusing. The two-stage machine learning network uses a modified YOLOv4 architecture with color channel separation (CCS) convolution, an image quality evaluation (IQE) module, and a frame fusion module to integrate the single frame detection results. This network can process multi-perspective video streams in real-time for defects detection in a coarse-to-fine manner. The AOI platform was trained with only 30 samples and achieved promising performances with a recall rate of 1, a detection accuracy of 97%, and an inspection time of 48 s per part.
AB - With the widespread deployment of wavelength division multiplexing (WDM), optical transceivers increasingly use many glass micro-optical components (GMOC). Visual inspection of these GMOCs is a critical manufacturing step to ensure quality and reliability. However, manual inspection is often labor-intensive and time-consuming due to the transparent nature of glass components and the small, randomly located defects in three dimensions. Although automated optical inspection (AOI) exists, it has not yet been able to provide the desired level of accuracy and efficiency. This paper reports the development of an AOI platform for 3D defect detection on GMOCs. The platform incorporates 3D video acquisition and a novel two-stage neural network machine-learning algorithm. It includes a robotic arm for moving parts in 3D, a camera with an illumination module for video acquisition, and a video streaming processing unit with a machine vision algorithm for real-time defect detection on a production line. The robotic arm enables multi-perspective video capture of a test sample without refocusing. The two-stage machine learning network uses a modified YOLOv4 architecture with color channel separation (CCS) convolution, an image quality evaluation (IQE) module, and a frame fusion module to integrate the single frame detection results. This network can process multi-perspective video streams in real-time for defects detection in a coarse-to-fine manner. The AOI platform was trained with only 30 samples and achieved promising performances with a recall rate of 1, a detection accuracy of 97%, and an inspection time of 48 s per part.
KW - 3D video acquisition
KW - Automated optical inspection
KW - Defects detection
KW - Glass micro-optical components
KW - Machine-learning algorithm
UR - http://www.scopus.com/inward/record.url?scp=85165232135&partnerID=8YFLogxK
U2 - 10.1016/j.optcom.2023.129736
DO - 10.1016/j.optcom.2023.129736
M3 - Article
AN - SCOPUS:85165232135
SN - 0030-4018
VL - 545
JO - Optics Communications
JF - Optics Communications
M1 - 129736
ER -