TY - JOUR
T1 - CGNet
T2 - Robotic Grasp Detection in Heavily Cluttered Scenes
AU - Yu, Sheng
AU - Zhai, Di Hua
AU - Xia, Yuanqing
N1 - Publisher Copyright:
© 1996-2012 IEEE.
PY - 2023/4/1
Y1 - 2023/4/1
N2 - Robotic grasp technology has been widely used. However, the robotic grasp in cluttered scene is still a challenging problem. In this regard, this article proposes a novel robotic grasp detection method cluttered grasp network (CGNet). First, to make the network fully focus on important features, this article proposes a novel attention module two branches squeeze-and-excitation residual network (TSE-ResNet) and uses it as the backbone to extract features. Then, to detect grasp rectangle more accurately, a novel grasp region proposal module is proposed, which can well utilize the multiscale features and refine the grasp region. Finally, a novel position focal loss is proposed to detect the rotation angle of the grasp rectangle, and can well solve the problem of discontinuous rotation angle. The CGNet is trained and tested on the GraspNet-1Billion dataset and Cornell dataset, achieving 87.9 and 97.9% accuracy, respectively. Moreover, to test the effectiveness, the CGNet is also tested on the Multiobject dataset and Clutter dataset. The detection results show that the CGNet can well detect the grasp rectangle when faces unseen objects. The ablation experiments are also performed to verify the performance of proposed modules. The experimental results show that the proposed modules can improve the detection accuracy in the cluttered scene. Finally, to evaluate the generalization of the CGNet, it is also evaluated in the real world, and applied to the grasp task of a real Baxter robot, and obtained a grasping success rate of 91.7%.
AB - Robotic grasp technology has been widely used. However, the robotic grasp in cluttered scene is still a challenging problem. In this regard, this article proposes a novel robotic grasp detection method cluttered grasp network (CGNet). First, to make the network fully focus on important features, this article proposes a novel attention module two branches squeeze-and-excitation residual network (TSE-ResNet) and uses it as the backbone to extract features. Then, to detect grasp rectangle more accurately, a novel grasp region proposal module is proposed, which can well utilize the multiscale features and refine the grasp region. Finally, a novel position focal loss is proposed to detect the rotation angle of the grasp rectangle, and can well solve the problem of discontinuous rotation angle. The CGNet is trained and tested on the GraspNet-1Billion dataset and Cornell dataset, achieving 87.9 and 97.9% accuracy, respectively. Moreover, to test the effectiveness, the CGNet is also tested on the Multiobject dataset and Clutter dataset. The detection results show that the CGNet can well detect the grasp rectangle when faces unseen objects. The ablation experiments are also performed to verify the performance of proposed modules. The experimental results show that the proposed modules can improve the detection accuracy in the cluttered scene. Finally, to evaluate the generalization of the CGNet, it is also evaluated in the real world, and applied to the grasp task of a real Baxter robot, and obtained a grasping success rate of 91.7%.
KW - Attention mechanism
KW - grasp detection
KW - grasp region
KW - position focal loss
KW - robot
UR - http://www.scopus.com/inward/record.url?scp=85139830959&partnerID=8YFLogxK
U2 - 10.1109/TMECH.2022.3209488
DO - 10.1109/TMECH.2022.3209488
M3 - Article
AN - SCOPUS:85139830959
SN - 1083-4435
VL - 28
SP - 884
EP - 894
JO - IEEE/ASME Transactions on Mechatronics
JF - IEEE/ASME Transactions on Mechatronics
IS - 2
ER -