Skip to main navigation Skip to search Skip to main content

YOLO-Based Human Pose Awareness for Occlusion-Challenged Human–Robot Collaborative Assembly

  • Bo Tong Hu
  • , Weifeng Luo
  • , Shangsi Wu
  • , Haonan Fang
  • , Guodong Mi
  • , Haipeng Sun
  • , Xiao Nan Yang*
  • *Corresponding author for this work
  • Hunan University
  • Ltd
  • Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Human–robot collaborative assembly (HRCA) has become an important paradigm in modern intelligent manufacturing, where robots must accurately perceive human posture and motion in order to ensure both operational safety and efficient cooperation. However, reliable human pose perception in real assembly environments remains challenging due to frequent occlusions, cluttered backgrounds, and complex human movements. To address these challenges, this paper proposes a human pose awareness framework for HRCA based on an enhanced YOLO11-Pose architecture, termed YOLO11-CKPose. The proposed framework integrates skeleton-based pose estimation with improved feature extraction and occlusion-aware detection mechanisms to enhance keypoint localization accuracy under partial visibility conditions. In addition, a dedicated human–robot collaborative assembly dataset is constructed using RGB-D sequences collected from 15 participants performing representative assembly tasks under multiple interference scenarios. Transfer learning is employed to adapt the model from the COCO dataset to the assembly-specific environment. Experimental results in both simulated and real assembly scenarios demonstrate that the proposed method achieves over 95% recognition accuracy, outperforming baseline YOLO-based pose models in terms of robustness and inference efficiency. The proposed framework provides reliable human pose perception for behavior recognition and safety-aware decision making, thereby supporting more adaptive and intelligent human–robot collaboration in complex assembly environments.

Original languageEnglish
Title of host publicationHuman-Computer Interaction - Thematic Area, HCI 2026, Held as Part of the 28th HCI International Conference, HCII 2026, Proceedings
EditorsMasaaki Kurosu, Ayako Hashizume
PublisherSpringer Science and Business Media Deutschland GmbH
Pages108-119
Number of pages12
ISBN (Print)9783032295859
DOIs
Publication statusPublished - 2026
EventHuman Interface and the Management of Information thematic area, HIMI 2026, held as part of the 28th International Conference on Human-Computer Interaction, HCII 2026 - Montreal, Canada
Duration: 26 Jul 202631 Jul 2026

Publication series

NameLecture Notes in Computer Science
Volume16702 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceHuman Interface and the Management of Information thematic area, HIMI 2026, held as part of the 28th International Conference on Human-Computer Interaction, HCII 2026
Country/TerritoryCanada
CityMontreal
Period26/07/2631/07/26

Keywords

  • Dynamic gesture recognition
  • Human pose awareness
  • Human-Robot Collaborative Assembly
  • Skeleton-based perception
  • YOLO11-Pose

Fingerprint

Dive into the research topics of 'YOLO-Based Human Pose Awareness for Occlusion-Challenged Human–Robot Collaborative Assembly'. Together they form a unique fingerprint.

Cite this