Online gesture recognition algorithm applied to hud based smart driving system

Jingyao Wang*, Jing Chen, Yuanyuan Qiao, Junyan Zhou, Yongtian Wang

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

8 引用 (Scopus)

摘要

In order to avoid driving distraction caused by traditional buttons or touch screens, gesture recognition technology has begun to be applied to the field of human-car interaction. Online gesture recognition system designed for vehicle needs powerful enough to satisfy the requirements of high classification accuracy, fast response time and low graphics memory consumption. To solve the above challenges, we propose an online gesture recognition algorithm based on RGB camera to identify motion, hand and gesture in sequence. We use the frame difference as a motion detection modality and apply the hand detection neural network to determine whether to activate the gesture classifier. In the gesture classifier, the frame difference is fused with the RGB image at data level based on Efficient Convolutional Network. We combined gesture recognition and Heads-Up Display to create a simulated driving system that allows users control auxiliary information through gestures, which used for usability analysis and user evaluation. For the purpose of finding the gestures that best match the various interactive tasks, we use the entropy weight method to analyze the usability of the gestures in the JESTER dataset and derive seven best gestures. The offline gesture classification accuracy on the JESTER dataset is 95.96% and online recognition algorithm runs on average at 306 fps when there is no motion and 164 fps in the presence of hand. According to the questionnaire results after the subjects used our system, more than 86.25% of the subjects expressed satisfaction with our gesture recognition system.

源语言英语
主期刊名Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
出版商Institute of Electrical and Electronics Engineers Inc.
289-294
页数6
ISBN(电子版)9781728147659
DOI
出版状态已出版 - 10月 2019
活动18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, 中国
期限: 14 10月 201918 10月 2019

出版系列

姓名Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019

会议

会议18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
国家/地区中国
Beijing
时期14/10/1918/10/19

指纹

探究 'Online gesture recognition algorithm applied to hud based smart driving system' 的科研主题。它们共同构成独一无二的指纹。

引用此