Research on Gesture Recognition System Using Multiple Sensors Based on Earth’s Magnetic Field and 1D Convolution Neural Network

Bo Shi, Xi Chen*, Zhongzheng He, Haoyang Sun, Ruoyu Han

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

A commonly used method of gesture recognition is the use of sensor technology. Typically, technology detecting Earth’s magnetic field is used in indoor positioning, and magnetic detection technology serves as a redundant method for gesture recognition devices. In this paper, we propose a novel system that utilizes multiple sensors measuring Earth’s magnetic field to collect data and perform gesture recognition through a one-dimensional convolutional neural network algorithm. By applying the detection of Earth’s magnetic field to gesture recognition, our system significantly improves the accuracy of recognition through a one-dimensional (1D) neural network algorithm. We conducted experiments where we collected and recognized American Sign Language standard letters, and achieved an accuracy rate close to 97%. Our experimental results demonstrate that this gesture recognition system using magnetic field sensors and a one-dimensional neural network algorithm is feasible for practical applications. Furthermore, our approach reduces the complexity of the device compared to the gesture recognition method based on artificial magnetic fields, while maintaining high recognition accuracy and not limiting the user’s hand movements. This technology holds great promise for the field of human–computer interaction.

Original languageEnglish
Article number5544
JournalApplied Sciences (Switzerland)
Volume13
Issue number9
DOIs
Publication statusPublished - May 2023

Keywords

  • deep learning
  • gesture recognition
  • human–computer interaction
  • magnetic detection
  • sign language recognition

Fingerprint

Dive into the research topics of 'Research on Gesture Recognition System Using Multiple Sensors Based on Earth’s Magnetic Field and 1D Convolution Neural Network'. Together they form a unique fingerprint.

Cite this