A Method of Assembly Guidance Information Delivery in Augmented Reality Considering Users’ Proficiency Levels

Xuanzhu Wan, Jun He, Xiaonan Yang*, Yaoguang Hu, Hongwei Niu, Jia Hao, Haonan Fang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In the era of rapidly advancing smart manufacturing, product assembly is facing higher demands for flexibility and efficiency. The application of Augmented Reality (AR) technology in human-assisted assembly tasks has been increasingly prevalent, which can reduce cognitive load and enhance assembly efficiency. However, existing AR assisted assembly systems often neglect Expertise Reversal Effect, which refers to the phenomenon where different instructional strategies may have opposite effects on inexperienced learners and proficient learners during the learning process. In the case, skilled operators are provided with redundant information, resulting in decreased assembly efficiency. Based on this, this study proposes a proficiency-level grading model, considering user state to recommend guidance information in AR assembly tasks. Firstly, we divide the guidance information into different levels, facilitating the provision of adaptive information content. Secondly, we use HoloLens2 to gather user state across different skill levels and develop a proficiency-level grading model. Finally, leveraging the aforementioned research outcomes, an Augmented Reality assembly system is developed, enabling proficiency-aware differential guidance information delivery in the actual reducer assembly scenario. This study provides a solution to mitigate the negative impact of the Expertise Reversal Effect in Augmented Reality assisted assembly, aiming to improve the efficiency of the assembly process and enhance the user experience of the system. The proposed method offers new perspectives and approaches for the development and application of Augmented Reality Assistant System.

Original languageEnglish
Title of host publicationHCI in Business, Government and Organizations - 12th International Conference, HCIBGO 2025, Held as Part of the 27th HCI International Conference, HCII 2025, Proceedings
EditorsKeng Leng Siau, Fiona Fui-Hoon Nah
PublisherSpringer Science and Business Media Deutschland GmbH
Pages65-76
Number of pages12
ISBN (Print)9783031928222
DOIs
Publication statusPublished - 2025
Externally publishedYes
Event12th International Conference on HCI in Business, Government and Organizations, held as part of the 27th HCI International Conference, HCII 2025 - Gothenburg, Sweden
Duration: 22 Jun 202527 Jun 2025

Publication series

NameLecture Notes in Computer Science
Volume15804 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Conference on HCI in Business, Government and Organizations, held as part of the 27th HCI International Conference, HCII 2025
Country/TerritorySweden
CityGothenburg
Period22/06/2527/06/25

Keywords

  • Adaptive guidance
  • Augmented Reality Assistant System
  • Differentiated information classification
  • Proficiency-level grading mode

Fingerprint

Dive into the research topics of 'A Method of Assembly Guidance Information Delivery in Augmented Reality Considering Users’ Proficiency Levels'. Together they form a unique fingerprint.

Cite this