跳到主要导航 跳到搜索 跳到主要内容

YOLO-Based Human Pose Awareness for Occlusion-Challenged Human–Robot Collaborative Assembly

  • Bo Tong Hu
  • , Weifeng Luo
  • , Shangsi Wu
  • , Haonan Fang
  • , Guodong Mi
  • , Haipeng Sun
  • , Xiao Nan Yang*
  • *此作品的通讯作者
  • Hunan University
  • Ltd
  • Beijing Institute of Technology

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Human–robot collaborative assembly (HRCA) has become an important paradigm in modern intelligent manufacturing, where robots must accurately perceive human posture and motion in order to ensure both operational safety and efficient cooperation. However, reliable human pose perception in real assembly environments remains challenging due to frequent occlusions, cluttered backgrounds, and complex human movements. To address these challenges, this paper proposes a human pose awareness framework for HRCA based on an enhanced YOLO11-Pose architecture, termed YOLO11-CKPose. The proposed framework integrates skeleton-based pose estimation with improved feature extraction and occlusion-aware detection mechanisms to enhance keypoint localization accuracy under partial visibility conditions. In addition, a dedicated human–robot collaborative assembly dataset is constructed using RGB-D sequences collected from 15 participants performing representative assembly tasks under multiple interference scenarios. Transfer learning is employed to adapt the model from the COCO dataset to the assembly-specific environment. Experimental results in both simulated and real assembly scenarios demonstrate that the proposed method achieves over 95% recognition accuracy, outperforming baseline YOLO-based pose models in terms of robustness and inference efficiency. The proposed framework provides reliable human pose perception for behavior recognition and safety-aware decision making, thereby supporting more adaptive and intelligent human–robot collaboration in complex assembly environments.

源语言英语
主期刊名Human-Computer Interaction - Thematic Area, HCI 2026, Held as Part of the 28th HCI International Conference, HCII 2026, Proceedings
编辑Masaaki Kurosu, Ayako Hashizume
出版商Springer Science and Business Media Deutschland GmbH
108-119
页数12
ISBN(印刷版)9783032295859
DOI
出版状态已出版 - 2026
活动Human Interface and the Management of Information thematic area, HIMI 2026, held as part of the 28th International Conference on Human-Computer Interaction, HCII 2026 - Montreal, 加拿大
期限: 26 7月 202631 7月 2026

出版系列

姓名Lecture Notes in Computer Science
16702 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议Human Interface and the Management of Information thematic area, HIMI 2026, held as part of the 28th International Conference on Human-Computer Interaction, HCII 2026
国家/地区加拿大
Montreal
时期26/07/2631/07/26

学术指纹

探究 'YOLO-Based Human Pose Awareness for Occlusion-Challenged Human–Robot Collaborative Assembly' 的科研主题。它们共同构成独一无二的学术指纹。

引用此