Assisted Human-Robot Interaction for Industry Application Based Augmented Reality

Haonan Fang*, Jingqian Wen, Xiao Nan Yang, Peng Wang, Yinqian Li

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Augmented Reality provides more possibilities for industrial manufacturing to solve the current problems. However, previous researches have been focused on virtual scene visualization and robot trajectory prediction. The investigation of robotic real-time teleoperation using AR is limited, which is still facing great challenges. In this research, a novel method is presented for human-robot interaction for industrial applications based on AR, like assembly. Users can intuitively teleoperate a 6-DOFs industry robot to recognize and locate entities by multi-channel operation via HoloLens2. Augmented reality, as a medium, bridges human zones and robot zones. The system can transform user instructions from virtual multi-channel user interface to robots by communication module in AR environment. The above approaches and related devices are elaborated in this paper. An industrial case is presented to implement and validate the feasibility of the AR-based human-robot interactive system. The results provide evidence to support that AR is one of the efficient methods to realize multi-channel human-robot interaction.

Original languageEnglish
Title of host publicationVirtual, Augmented and Mixed Reality
Subtitle of host publicationApplications in Education, Aviation and Industry - 14th International Conference, VAMR 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings
EditorsJessie Y. Chen, Gino Fragomeni
PublisherSpringer Science and Business Media Deutschland GmbH
Pages291-301
Number of pages11
ISBN (Print)9783031060144
DOIs
Publication statusPublished - 2022
Event14th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2022 Held as Part of the 24th HCI International Conference, HCII 2022 - Virtual, Online
Duration: 26 Jun 20221 Jul 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13318 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2022 Held as Part of the 24th HCI International Conference, HCII 2022
CityVirtual, Online
Period26/06/221/07/22

Keywords

  • Augmented Reality
  • Human-robot interaction
  • Manufacturing industry

Fingerprint

Dive into the research topics of 'Assisted Human-Robot Interaction for Industry Application Based Augmented Reality'. Together they form a unique fingerprint.

Cite this