Research on Real-Time Motion Classification and Counting Algorithm Based on Video

Mengyun Ke*, Zhuang Ma, Chongwen Wang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

High quality exercise data can often provide a basis for people to formulate scientific fitness plans. At present, the methods of motion recognition and counting through manual quantization or wearable devices with sensors are poor in convenience, visualization, efficiency and accuracy. This paper presents a real-time motion classification and counting method using computer vision technology, which makes up for the shortcomings of the previous methods. Firstly, a lightweight human posture estimation network MPE is designed to extract human bone point data, and then the data of human bone points are processed for motion classification. Finally, based on the classification results, the counting algorithm proposed in this paper is used for real-time motion counting. The counting algorithm can customize the counting standard to standardize the motion action. This method can meet the counting scene of a single person doing a variety of movements alternately. This paper mainly carries out experiments on five kinds of sports including squats, sit-ups, push-ups, pull-ups and jumping jacks. The experimental results show that the PCKh index of MPE network reaches 85.9 on MPII dataset and the AP index reaches 65.0 on COCO dataset. It also performs well in lightweight, with only 5.8G FLOPs and 5.6M model parameters. In addition, the classification accuracy of KNN classification network based on MPE is 95% on self-made dataset. The accuracy of counting is 93%, and the accuracy of counting ± 1 is 97%.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages433-440
Number of pages8
ISBN (Electronic)9798350346558
DOIs
Publication statusPublished - 2022
Event2022 IEEE SmartWorld, 19th IEEE International Conference on Ubiquitous Intelligence and Computing, 2022 IEEE International Conference on Autonomous and Trusted Vehicles Conference, 22nd IEEE International Conference on Scalable Computing and Communications, 2022 IEEE International Conference on Digital Twin, 8th IEEE International Conference on Privacy Computing and 2022 IEEE International Conference on Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022 - Haikou, China
Duration: 15 Dec 202218 Dec 2022

Publication series

NameProceedings - 2022 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022

Conference

Conference2022 IEEE SmartWorld, 19th IEEE International Conference on Ubiquitous Intelligence and Computing, 2022 IEEE International Conference on Autonomous and Trusted Vehicles Conference, 22nd IEEE International Conference on Scalable Computing and Communications, 2022 IEEE International Conference on Digital Twin, 8th IEEE International Conference on Privacy Computing and 2022 IEEE International Conference on Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
Country/TerritoryChina
CityHaikou
Period15/12/2218/12/22

Keywords

  • Human posture estimation
  • Motion classification
  • Motion counting

Fingerprint

Dive into the research topics of 'Research on Real-Time Motion Classification and Counting Algorithm Based on Video'. Together they form a unique fingerprint.

Cite this