Development of magnetic-sensor-based hand gesture recognition system for sign language

Bo Shi; Xi Chen; Zhongzheng He; Ruoyu Han

doi:10.1109/CIEEC58067.2023.10167092

Development of magnetic-sensor-based hand gesture recognition system for sign language

Bo Shi
, Xi Chen^*
, Zhongzheng He
, Ruoyu Han

^*Corresponding author for this work

School of Mechatronical Engineering

Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

Sign language recognition is essential for the automatic translation of sign languages to enable communication for hearing-impaired people. This work proposes a system based on multiple magnetic sensors for recognizing hand gestures related to sign language alphabets. In particular, a magnetic detection system consisting of six magnetic sensor nodes measures the orientation of fingers and palms. A deep learning classification algorithm processes the measured orientation data. Experimental tests validate the proposed system and classification method. The results show that the proposed method provides close to 100% classification accuracy for 26 sign language alphabets under laboratory conditions. Thus, the feasibility of the proposed gesture recognition system for automatic translation of sign language alphabets is proved.

Original language	English
Title of host publication	2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	2302-2305
Number of pages	4
ISBN (Electronic)	9798350346671
DOIs	https://doi.org/10.1109/CIEEC58067.2023.10167092
Publication status	Published - 2023
Event	6th IEEE International Electrical and Energy Conference, CIEEC 2023 - Hefei, China Duration: 12 May 2023 → 14 May 2023

Publication series

Name	2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023

Conference

Conference	6th IEEE International Electrical and Energy Conference, CIEEC 2023
Country/Territory	China
City	Hefei
Period	12/05/23 → 14/05/23

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 7 Affordable and Clean Energy

Keywords

IoT
gesture recognition
magnetic detection
status detection
system integration

Access to Document

10.1109/CIEEC58067.2023.10167092

Cite this

Shi, B., Chen, X., He, Z., & Han, R. (2023). Development of magnetic-sensor-based hand gesture recognition system for sign language. In 2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023 (pp. 2302-2305). (2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CIEEC58067.2023.10167092

@inproceedings{6f353484beae48738f57e80c4e2d57c4,

title = "Development of magnetic-sensor-based hand gesture recognition system for sign language",

abstract = "Sign language recognition is essential for the automatic translation of sign languages to enable communication for hearing-impaired people. This work proposes a system based on multiple magnetic sensors for recognizing hand gestures related to sign language alphabets. In particular, a magnetic detection system consisting of six magnetic sensor nodes measures the orientation of fingers and palms. A deep learning classification algorithm processes the measured orientation data. Experimental tests validate the proposed system and classification method. The results show that the proposed method provides close to 100\% classification accuracy for 26 sign language alphabets under laboratory conditions. Thus, the feasibility of the proposed gesture recognition system for automatic translation of sign language alphabets is proved.",

keywords = "IoT, gesture recognition, magnetic detection, status detection, system integration",

author = "Bo Shi and Xi Chen and Zhongzheng He and Ruoyu Han",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 6th IEEE International Electrical and Energy Conference, CIEEC 2023 ; Conference date: 12-05-2023 Through 14-05-2023",

year = "2023",

doi = "10.1109/CIEEC58067.2023.10167092",

language = "English",

series = "2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "2302--2305",

booktitle = "2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023",

address = "United States",

}

Shi, B, Chen, X, He, Z & Han, R 2023, Development of magnetic-sensor-based hand gesture recognition system for sign language. in 2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023. 2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023, Institute of Electrical and Electronics Engineers Inc., pp. 2302-2305, 6th IEEE International Electrical and Energy Conference, CIEEC 2023, Hefei, China, 12/05/23. https://doi.org/10.1109/CIEEC58067.2023.10167092

Development of magnetic-sensor-based hand gesture recognition system for sign language. / Shi, Bo; Chen, Xi; He, Zhongzheng et al.
2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 2302-2305 (2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Development of magnetic-sensor-based hand gesture recognition system for sign language

AU - Shi, Bo

AU - Chen, Xi

AU - He, Zhongzheng

AU - Han, Ruoyu

PY - 2023

Y1 - 2023

N2 - Sign language recognition is essential for the automatic translation of sign languages to enable communication for hearing-impaired people. This work proposes a system based on multiple magnetic sensors for recognizing hand gestures related to sign language alphabets. In particular, a magnetic detection system consisting of six magnetic sensor nodes measures the orientation of fingers and palms. A deep learning classification algorithm processes the measured orientation data. Experimental tests validate the proposed system and classification method. The results show that the proposed method provides close to 100% classification accuracy for 26 sign language alphabets under laboratory conditions. Thus, the feasibility of the proposed gesture recognition system for automatic translation of sign language alphabets is proved.

AB - Sign language recognition is essential for the automatic translation of sign languages to enable communication for hearing-impaired people. This work proposes a system based on multiple magnetic sensors for recognizing hand gestures related to sign language alphabets. In particular, a magnetic detection system consisting of six magnetic sensor nodes measures the orientation of fingers and palms. A deep learning classification algorithm processes the measured orientation data. Experimental tests validate the proposed system and classification method. The results show that the proposed method provides close to 100% classification accuracy for 26 sign language alphabets under laboratory conditions. Thus, the feasibility of the proposed gesture recognition system for automatic translation of sign language alphabets is proved.

KW - IoT

KW - gesture recognition

KW - magnetic detection

KW - status detection

KW - system integration

UR - https://www.scopus.com/pages/publications/85167625342

U2 - 10.1109/CIEEC58067.2023.10167092

DO - 10.1109/CIEEC58067.2023.10167092

M3 - Conference contribution

AN - SCOPUS:85167625342

T3 - 2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023

SP - 2302

EP - 2305

BT - 2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 6th IEEE International Electrical and Energy Conference, CIEEC 2023

Y2 - 12 May 2023 through 14 May 2023

ER -

Shi B, Chen X, He Z, Han R. Development of magnetic-sensor-based hand gesture recognition system for sign language. In 2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 2302-2305. (2023 IEEE 6th International Electrical and Energy Conference, CIEEC 2023). doi: 10.1109/CIEEC58067.2023.10167092

Development of magnetic-sensor-based hand gesture recognition system for sign language

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this