A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System

Le Luo; Dongdong Weng; Jie Hao; Ziqi Tu; Bin Liang; Haiyan Jiang

doi:10.1109/VRW58643.2023.00217

A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System

Le Luo, Dongdong Weng^*, Jie Hao, Ziqi Tu, Bin Liang, Haiyan Jiang

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Citation (Scopus)

Abstract

In mixed-reality telecollaboration, it is often difficult for remote users to actively and naturally control the viewpoint. We propose a viewpoint controllable telepresence with a robotic arm that carries a stereo camera in the local environment so that the remote user can control the robotic arm by moving his or her head to actively and flexibly observe the local environment. Additionally, we built a mixed-reality telecollaboration prototype that adds avatar and nonverbal cues for the remote user to the local user side, enabling the remote user to better guide the local user. In this paper, we discuss our prototype, make design recommendations, and discuss configuration and implementation.

Original language	English
Title of host publication	Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	749-750
Number of pages	2
ISBN (Electronic)	9798350348392
DOIs	https://doi.org/10.1109/VRW58643.2023.00217
Publication status	Published - 2023
Event	2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 - Shanghai, China Duration: 25 Mar 2023 → 29 Mar 2023

Publication series

Name	Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

Conference

Conference	2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
Country/Territory	China
City	Shanghai
Period	25/03/23 → 29/03/23

Keywords

Human computer interaction (HCI)
Human-centered computing
Interaction paradigms
Mixed / augmented reality

Access to Document

10.1109/VRW58643.2023.00217

Cite this

Luo, L., Weng, D., Hao, J., Tu, Z., Liang, B., & Jiang, H. (2023). A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System. In Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 (pp. 749-750). (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VRW58643.2023.00217

Luo, Le ; Weng, Dongdong ; Hao, Jie et al. / A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System. Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 749-750 (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023).

@inproceedings{85c52bbe69d34e6a9d1f728e6296e9c4,

title = "A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System",

abstract = "In mixed-reality telecollaboration, it is often difficult for remote users to actively and naturally control the viewpoint. We propose a viewpoint controllable telepresence with a robotic arm that carries a stereo camera in the local environment so that the remote user can control the robotic arm by moving his or her head to actively and flexibly observe the local environment. Additionally, we built a mixed-reality telecollaboration prototype that adds avatar and nonverbal cues for the remote user to the local user side, enabling the remote user to better guide the local user. In this paper, we discuss our prototype, make design recommendations, and discuss configuration and implementation.",

keywords = "Human computer interaction (HCI), Human-centered computing, Interaction paradigms, Mixed / augmented reality",

author = "Le Luo and Dongdong Weng and Jie Hao and Ziqi Tu and Bin Liang and Haiyan Jiang",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 ; Conference date: 25-03-2023 Through 29-03-2023",

year = "2023",

doi = "10.1109/VRW58643.2023.00217",

language = "English",

series = "Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "749--750",

booktitle = "Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023",

address = "United States",

}

Luo, L, Weng, D, Hao, J, Tu, Z, Liang, B & Jiang, H 2023, A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System. in Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023, Institute of Electrical and Electronics Engineers Inc., pp. 749-750, 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023, Shanghai, China, 25/03/23. https://doi.org/10.1109/VRW58643.2023.00217

A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System. / Luo, Le; Weng, Dongdong; Hao, Jie et al.
Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 749-750 (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System

AU - Luo, Le

AU - Weng, Dongdong

AU - Hao, Jie

AU - Tu, Ziqi

AU - Liang, Bin

AU - Jiang, Haiyan

PY - 2023

Y1 - 2023

N2 - In mixed-reality telecollaboration, it is often difficult for remote users to actively and naturally control the viewpoint. We propose a viewpoint controllable telepresence with a robotic arm that carries a stereo camera in the local environment so that the remote user can control the robotic arm by moving his or her head to actively and flexibly observe the local environment. Additionally, we built a mixed-reality telecollaboration prototype that adds avatar and nonverbal cues for the remote user to the local user side, enabling the remote user to better guide the local user. In this paper, we discuss our prototype, make design recommendations, and discuss configuration and implementation.

AB - In mixed-reality telecollaboration, it is often difficult for remote users to actively and naturally control the viewpoint. We propose a viewpoint controllable telepresence with a robotic arm that carries a stereo camera in the local environment so that the remote user can control the robotic arm by moving his or her head to actively and flexibly observe the local environment. Additionally, we built a mixed-reality telecollaboration prototype that adds avatar and nonverbal cues for the remote user to the local user side, enabling the remote user to better guide the local user. In this paper, we discuss our prototype, make design recommendations, and discuss configuration and implementation.

KW - Human computer interaction (HCI)

KW - Human-centered computing

KW - Interaction paradigms

KW - Mixed / augmented reality

UR - http://www.scopus.com/inward/record.url?scp=85159668044&partnerID=8YFLogxK

U2 - 10.1109/VRW58643.2023.00217

DO - 10.1109/VRW58643.2023.00217

M3 - Conference contribution

AN - SCOPUS:85159668044

T3 - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

SP - 749

EP - 750

BT - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

Y2 - 25 March 2023 through 29 March 2023

ER -

Luo L, Weng D, Hao J, Tu Z, Liang B, Jiang H. A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System. In Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 749-750. (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023). doi: 10.1109/VRW58643.2023.00217

A Robotic Arm-based Telepresence for Mixed-Reality Telecollaboration System

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this