TY - JOUR
T1 - 6D pose annotation and pose estimation method for weak-corner objects under low-light conditions
AU - Jiang, Zhi Hong
AU - Chen, Jin Hong
AU - Jing, Ya Man
AU - Huang, Xiao
AU - Li, Hui
N1 - Publisher Copyright:
© 2023, Science China Press.
PY - 2023/3
Y1 - 2023/3
N2 - In unstructured environments such as disaster sites and mine tunnels, it is a challenge for robots to estimate the poses of objects under complex lighting backgrounds, which limit their operation. Owing to the shadows produced by a point light source, the brightness of the operation scene is seriously unbalanced, and it is difficult to accurately extract the features of objects. It is especially difficult to accurately label the poses of objects with weak corners and textures. This study proposes an automatic pose annotation method for such objects, which combine 3D-2D matching projection and rendering technology to improve the efficiency of dataset annotation. A 6D object pose estimation method under low-light conditions (LP_TGC) is then proposed, including (1) a light preprocessing neural network model based on a low-light preprocessing module (LPM) to balance the brightness of a picture and improve its quality; and (2) a 6D pose estimation model (TGC) based on the keypoint matching. Four typical datasets are constructed to verify our method, the experimental results validated and demonstrated the effectiveness of the proposed LP_TGC method. The estimation model based on the preprocessed image can accurately estimate the pose of the object in the mentioned unstructured environments, and it can improve the accuracy by an average of ∼3% based on the ADD metric.
AB - In unstructured environments such as disaster sites and mine tunnels, it is a challenge for robots to estimate the poses of objects under complex lighting backgrounds, which limit their operation. Owing to the shadows produced by a point light source, the brightness of the operation scene is seriously unbalanced, and it is difficult to accurately extract the features of objects. It is especially difficult to accurately label the poses of objects with weak corners and textures. This study proposes an automatic pose annotation method for such objects, which combine 3D-2D matching projection and rendering technology to improve the efficiency of dataset annotation. A 6D object pose estimation method under low-light conditions (LP_TGC) is then proposed, including (1) a light preprocessing neural network model based on a low-light preprocessing module (LPM) to balance the brightness of a picture and improve its quality; and (2) a 6D pose estimation model (TGC) based on the keypoint matching. Four typical datasets are constructed to verify our method, the experimental results validated and demonstrated the effectiveness of the proposed LP_TGC method. The estimation model based on the preprocessed image can accurately estimate the pose of the object in the mentioned unstructured environments, and it can improve the accuracy by an average of ∼3% based on the ADD metric.
KW - 6D object pose estimation
KW - 6D pose annotation
KW - low-light conditions
UR - http://www.scopus.com/inward/record.url?scp=85146634502&partnerID=8YFLogxK
U2 - 10.1007/s11431-021-2087-8
DO - 10.1007/s11431-021-2087-8
M3 - Article
AN - SCOPUS:85146634502
SN - 1674-7321
VL - 66
SP - 630
EP - 640
JO - Science China Technological Sciences
JF - Science China Technological Sciences
IS - 3
ER -