NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality

Tianyu Li; Yue Liu; Shining Ma; Mingwei Hu; Tong Liu; Weitao Song

doi:10.1109/ISMAR55827.2022.00032

NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality

Tianyu Li, Yue Liu^*, Shining Ma, Mingwei Hu, Tong Liu, Weitao Song

^*Corresponding author for this work

School of Optics and Photonics

Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Citation (Scopus)

Abstract

Gesture interaction is currently a main interaction technology in the field of mixed reality. However, long-term and large-scale gesture in mid-air will lead to muscle fatigue and privacy problems, which cannot meet the comfort requirements of continuous interaction and inevitably hinder the development of mixed reality systems. To solve this problem, we propose NailRing, an intelligent ring to recognize fingertip micro-gestures using a micro-close-focus camera on a fingertip bracket. Such fingertip physiological characteristics as the changes in fingertip color distribution and muscle shape changes caused by fingertip pressure have been studied. According to the recognition principle, ten types of micro-gestures have been designed and used for contact interaction and one-hand interaction respectively. The accuracy of gesture recognition (cross-session FMacro=98.3\%; cross-person FMacro=86.4%) in user studies verifies the performances of NailRing under different interaction conditions. Finally, the capability of NailRing in a series of potential application scenarios has also been discussed and analyzed.

Original language	English
Title of host publication	Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
Editors	Henry Duh, Ian Williams, Jens Grubert, J. Adam Jones, Jianmin Zheng
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	178-186
Number of pages	9
ISBN (Electronic)	9781665453257
DOIs	https://doi.org/10.1109/ISMAR55827.2022.00032
Publication status	Published - 2022
Event	21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022 - Singapore, Singapore Duration: 17 Oct 2022 → 21 Oct 2022

Publication series

Name	Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022

Conference

Conference	21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
Country/Territory	Singapore
City	Singapore
Period	17/10/22 → 21/10/22

Keywords

Gestural input
Human computer interaction (HCI)
Human-centered computing
Interaction paradigms-Mixed/augmented reality
Interaction techniques

Access to Document

10.1109/ISMAR55827.2022.00032

Cite this

Li, T., Liu, Y., Ma, S., Hu, M., Liu, T., & Song, W. (2022). NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality. In H. Duh, I. Williams, J. Grubert, J. A. Jones, & J. Zheng (Eds.), Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022 (pp. 178-186). (Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR55827.2022.00032

Li, Tianyu ; Liu, Yue ; Ma, Shining et al. / NailRing : An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality. Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022. editor / Henry Duh ; Ian Williams ; Jens Grubert ; J. Adam Jones ; Jianmin Zheng. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 178-186 (Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022).

@inproceedings{439cafa7c6cd44ab8220c844da8a361d,

title = "NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality",

abstract = "Gesture interaction is currently a main interaction technology in the field of mixed reality. However, long-term and large-scale gesture in mid-air will lead to muscle fatigue and privacy problems, which cannot meet the comfort requirements of continuous interaction and inevitably hinder the development of mixed reality systems. To solve this problem, we propose NailRing, an intelligent ring to recognize fingertip micro-gestures using a micro-close-focus camera on a fingertip bracket. Such fingertip physiological characteristics as the changes in fingertip color distribution and muscle shape changes caused by fingertip pressure have been studied. According to the recognition principle, ten types of micro-gestures have been designed and used for contact interaction and one-hand interaction respectively. The accuracy of gesture recognition (cross-session FMacro=98.3\%; cross-person FMacro=86.4%) in user studies verifies the performances of NailRing under different interaction conditions. Finally, the capability of NailRing in a series of potential application scenarios has also been discussed and analyzed.",

keywords = "Gestural input, Human computer interaction (HCI), Human-centered computing, Interaction paradigms-Mixed/augmented reality, Interaction techniques",

author = "Tianyu Li and Yue Liu and Shining Ma and Mingwei Hu and Tong Liu and Weitao Song",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022 ; Conference date: 17-10-2022 Through 21-10-2022",

year = "2022",

doi = "10.1109/ISMAR55827.2022.00032",

language = "English",

series = "Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "178--186",

editor = "Henry Duh and Ian Williams and Jens Grubert and Jones, {J. Adam} and Jianmin Zheng",

booktitle = "Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022",

address = "United States",

}

Li, T, Liu, Y , Ma, S, Hu, M, Liu, T & Song, W 2022, NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality. in H Duh, I Williams, J Grubert, JA Jones & J Zheng (eds), Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022. Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022, Institute of Electrical and Electronics Engineers Inc., pp. 178-186, 21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022, Singapore, Singapore, 17/10/22. https://doi.org/10.1109/ISMAR55827.2022.00032

NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality. / Li, Tianyu; Liu, Yue ; Ma, Shining et al.
Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022. ed. / Henry Duh; Ian Williams; Jens Grubert; J. Adam Jones; Jianmin Zheng. Institute of Electrical and Electronics Engineers Inc., 2022. p. 178-186 (Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - NailRing

T2 - 21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022

AU - Li, Tianyu

AU - Liu, Yue

AU - Ma, Shining

AU - Hu, Mingwei

AU - Liu, Tong

AU - Song, Weitao

PY - 2022

Y1 - 2022

N2 - Gesture interaction is currently a main interaction technology in the field of mixed reality. However, long-term and large-scale gesture in mid-air will lead to muscle fatigue and privacy problems, which cannot meet the comfort requirements of continuous interaction and inevitably hinder the development of mixed reality systems. To solve this problem, we propose NailRing, an intelligent ring to recognize fingertip micro-gestures using a micro-close-focus camera on a fingertip bracket. Such fingertip physiological characteristics as the changes in fingertip color distribution and muscle shape changes caused by fingertip pressure have been studied. According to the recognition principle, ten types of micro-gestures have been designed and used for contact interaction and one-hand interaction respectively. The accuracy of gesture recognition (cross-session FMacro=98.3\%; cross-person FMacro=86.4%) in user studies verifies the performances of NailRing under different interaction conditions. Finally, the capability of NailRing in a series of potential application scenarios has also been discussed and analyzed.

AB - Gesture interaction is currently a main interaction technology in the field of mixed reality. However, long-term and large-scale gesture in mid-air will lead to muscle fatigue and privacy problems, which cannot meet the comfort requirements of continuous interaction and inevitably hinder the development of mixed reality systems. To solve this problem, we propose NailRing, an intelligent ring to recognize fingertip micro-gestures using a micro-close-focus camera on a fingertip bracket. Such fingertip physiological characteristics as the changes in fingertip color distribution and muscle shape changes caused by fingertip pressure have been studied. According to the recognition principle, ten types of micro-gestures have been designed and used for contact interaction and one-hand interaction respectively. The accuracy of gesture recognition (cross-session FMacro=98.3\%; cross-person FMacro=86.4%) in user studies verifies the performances of NailRing under different interaction conditions. Finally, the capability of NailRing in a series of potential application scenarios has also been discussed and analyzed.

KW - Gestural input

KW - Human computer interaction (HCI)

KW - Human-centered computing

KW - Interaction paradigms-Mixed/augmented reality

KW - Interaction techniques

UR - http://www.scopus.com/inward/record.url?scp=85146416336&partnerID=8YFLogxK

U2 - 10.1109/ISMAR55827.2022.00032

DO - 10.1109/ISMAR55827.2022.00032

M3 - Conference contribution

AN - SCOPUS:85146416336

T3 - Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022

SP - 178

EP - 186

BT - Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022

A2 - Duh, Henry

A2 - Williams, Ian

A2 - Grubert, Jens

A2 - Jones, J. Adam

A2 - Zheng, Jianmin

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 17 October 2022 through 21 October 2022

ER -

Li T, Liu Y , Ma S, Hu M, Liu T, Song W. NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality. In Duh H, Williams I, Grubert J, Jones JA, Zheng J, editors, Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 178-186. (Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022). doi: 10.1109/ISMAR55827.2022.00032

NailRing: An Intelligent Ring for Recognizing Micro-gestures in Mixed Reality

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this