TY - GEN
T1 - A Commonsense Knowledge-based Object Retrieval Approach for Virtual Reality
AU - Jiang, Haiyan
AU - Weng, Dongdong
AU - Dongye, Xiaonuo
AU - Zhang, Nan
AU - Le, Luo
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Out-of-reach object retrieval is an important task in many applications in virtual reality. Hand gestures have been widely studied for object retrieval. However, the one-to-one mapping metaphor of the gesture would cause ambiguity problems and memory burdens for the retrieval of plenty of objects. Therefore, we proposed a grasping gesture-based object retrieval approach for out-of-reach objects based on a graphical model called And-Or graphs (AOG), leveraging the scene-object occurrence, object co-occurrence, and human grasp commonsense knowledge. This approach enables users to acquire objects by using natural grasping gestures according to their experience of grasping physical objects. Importantly, users could perform the same grasping gesture for different virtual objects and perform different grasping gestures for one virtual object in the virtual environment.
AB - Out-of-reach object retrieval is an important task in many applications in virtual reality. Hand gestures have been widely studied for object retrieval. However, the one-to-one mapping metaphor of the gesture would cause ambiguity problems and memory burdens for the retrieval of plenty of objects. Therefore, we proposed a grasping gesture-based object retrieval approach for out-of-reach objects based on a graphical model called And-Or graphs (AOG), leveraging the scene-object occurrence, object co-occurrence, and human grasp commonsense knowledge. This approach enables users to acquire objects by using natural grasping gestures according to their experience of grasping physical objects. Importantly, users could perform the same grasping gesture for different virtual objects and perform different grasping gestures for one virtual object in the virtual environment.
KW - Gestural input
KW - Human computer interaction (HCI)
KW - Human-centered computing
KW - Interaction techniques
UR - http://www.scopus.com/inward/record.url?scp=85159671569&partnerID=8YFLogxK
U2 - 10.1109/VRW58643.2023.00240
DO - 10.1109/VRW58643.2023.00240
M3 - Conference contribution
AN - SCOPUS:85159671569
T3 - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
SP - 795
EP - 796
BT - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
Y2 - 25 March 2023 through 29 March 2023
ER -