TY - GEN
T1 - YOLO-Based Human Pose Awareness for Occlusion-Challenged Human–Robot Collaborative Assembly
AU - Hu, Bo Tong
AU - Luo, Weifeng
AU - Wu, Shangsi
AU - Fang, Haonan
AU - Mi, Guodong
AU - Sun, Haipeng
AU - Yang, Xiao Nan
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2026.
PY - 2026
Y1 - 2026
N2 - Human–robot collaborative assembly (HRCA) has become an important paradigm in modern intelligent manufacturing, where robots must accurately perceive human posture and motion in order to ensure both operational safety and efficient cooperation. However, reliable human pose perception in real assembly environments remains challenging due to frequent occlusions, cluttered backgrounds, and complex human movements. To address these challenges, this paper proposes a human pose awareness framework for HRCA based on an enhanced YOLO11-Pose architecture, termed YOLO11-CKPose. The proposed framework integrates skeleton-based pose estimation with improved feature extraction and occlusion-aware detection mechanisms to enhance keypoint localization accuracy under partial visibility conditions. In addition, a dedicated human–robot collaborative assembly dataset is constructed using RGB-D sequences collected from 15 participants performing representative assembly tasks under multiple interference scenarios. Transfer learning is employed to adapt the model from the COCO dataset to the assembly-specific environment. Experimental results in both simulated and real assembly scenarios demonstrate that the proposed method achieves over 95% recognition accuracy, outperforming baseline YOLO-based pose models in terms of robustness and inference efficiency. The proposed framework provides reliable human pose perception for behavior recognition and safety-aware decision making, thereby supporting more adaptive and intelligent human–robot collaboration in complex assembly environments.
AB - Human–robot collaborative assembly (HRCA) has become an important paradigm in modern intelligent manufacturing, where robots must accurately perceive human posture and motion in order to ensure both operational safety and efficient cooperation. However, reliable human pose perception in real assembly environments remains challenging due to frequent occlusions, cluttered backgrounds, and complex human movements. To address these challenges, this paper proposes a human pose awareness framework for HRCA based on an enhanced YOLO11-Pose architecture, termed YOLO11-CKPose. The proposed framework integrates skeleton-based pose estimation with improved feature extraction and occlusion-aware detection mechanisms to enhance keypoint localization accuracy under partial visibility conditions. In addition, a dedicated human–robot collaborative assembly dataset is constructed using RGB-D sequences collected from 15 participants performing representative assembly tasks under multiple interference scenarios. Transfer learning is employed to adapt the model from the COCO dataset to the assembly-specific environment. Experimental results in both simulated and real assembly scenarios demonstrate that the proposed method achieves over 95% recognition accuracy, outperforming baseline YOLO-based pose models in terms of robustness and inference efficiency. The proposed framework provides reliable human pose perception for behavior recognition and safety-aware decision making, thereby supporting more adaptive and intelligent human–robot collaboration in complex assembly environments.
KW - Dynamic gesture recognition
KW - Human pose awareness
KW - Human-Robot Collaborative Assembly
KW - Skeleton-based perception
KW - YOLO11-Pose
UR - https://www.scopus.com/pages/publications/105045697966
U2 - 10.1007/978-3-032-29586-6_8
DO - 10.1007/978-3-032-29586-6_8
M3 - Conference contribution
AN - SCOPUS:105045697966
SN - 9783032295859
T3 - Lecture Notes in Computer Science
SP - 108
EP - 119
BT - Human-Computer Interaction - Thematic Area, HCI 2026, Held as Part of the 28th HCI International Conference, HCII 2026, Proceedings
A2 - Kurosu, Masaaki
A2 - Hashizume, Ayako
PB - Springer Science and Business Media Deutschland GmbH
T2 - Human Interface and the Management of Information thematic area, HIMI 2026, held as part of the 28th International Conference on Human-Computer Interaction, HCII 2026
Y2 - 26 July 2026 through 31 July 2026
ER -