Research on gesture image recognition method based on transfer learning

Fei Wang, Ronglin Hu*, Ying Jin

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

16 Citations (Scopus)

Abstract

To solve the problem of low gesture image recognition rate, we propose a transfer learning based image recognition method called Mobilenet-RF. We combine the two models of MobileNet convolutional network with Random Forest to further improve image recognition accuracy. This method firstly transfers the model architecture and weight files of MobileNet to gesture images, trains the model and extracts image features, and then classifies the features extracted by convolutional network through the Random Forest model, and finally obtains the classification results. The test results on the Sign Language Digital dataset, Sign Language Gesture Image dataset and Fingers dataset showed that the recognition rate was significantly improved compared with Random Forest, Logistic Regression, Nearest Neighbor, XGBoost, VGG, Inception and MobileNet.

Original languageEnglish
Pages (from-to)140-145
Number of pages6
JournalProcedia Computer Science
Volume187
DOIs
Publication statusPublished - 2021
Externally publishedYes
Event9th International Conference on Identification, Information and Knowledge in the Internet of Things, IIKI 2020 - Zhuhai, China
Duration: 27 Nov 202029 Nov 2020

Keywords

  • Gesture image identification
  • convolution neural network
  • random forest
  • transfer learning

Fingerprint

Dive into the research topics of 'Research on gesture image recognition method based on transfer learning'. Together they form a unique fingerprint.

Cite this