Enhancing User Experience in Robotic Massage Therapy through Mixed Reality and Conversational Virtual Digital Humans

Yihua Bao, Dongdong Weng*, Xiaonuo Dongye, Mo Su, Nan Gao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This poster investigates the role of mixed reality in enhancing user experience in robotic massage therapy, particularly through the integration of conversational virtual digital humans. A high-fidelity digital human system was developed and synchronized with the robotic massage system to achieve realistic 3D virtual-real alignment. The system employs a large model-based dialogue system for natural user interactions. In a Latin square design experiment with 13 participants, three environments were tested: a virtual robotic arm, a non-interactive virtual human, and an interactive virtual human. Results indicate that the interactive virtual human, when integrated with mixed reality, significantly improves user experience, enhancing system humanization and affinity. This study underscores the potential of mixed reality in advancing robotic massage therapy and provides insights for designing more human-centered robotic systems.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2024
EditorsUlrich Eck, Misha Sra, Jeanine Stefanucci, Maki Sugimoto, Markus Tatzgern, Ian Williams
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages341-342
Number of pages2
ISBN (Electronic)9798331506919
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2024 - Seattle, United States
Duration: 21 Oct 202425 Oct 2024

Publication series

NameProceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2024

Conference

Conference2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2024
Country/TerritoryUnited States
CitySeattle
Period21/10/2425/10/24

Keywords

  • High-Fidelity Digital Human
  • Mixed Reality
  • Robotic Massage

Cite this