3d human pose estimation based on multi view information fusion

Shuo Zhang, Ming Liu*, Yuejin Zhao, Liquan Dong, Lingqin Kong

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

3D human pose estimation refers to recovering the pose of the human body in the three-dimensional space from the image, which is estimating the coordinates of the key points of the human body in the three-dimensional coordinate system. The human skeleton model composed of these keypoints describes the human pose in the image.The traditional pose estimation method uses motion capture equipment, which requires athletes to wear auxiliary equipment and affects the normal training of athletes. With the development of deep learning, convolutional neural network has shown strong representational capabilities in the process of image feature extraction, and is an effective method to achieve human pose estimation. However, in the actual complex and changeable three-dimensional space, the environment is noisy and the limbs are occluded. The monocular capture of human posture has the problems of low accuracy and instability, and cannot provide sufficient semantic information.To solve this poroblem, this paper designs a multi-view information fusion algorithm. First, a two-dimensional attitude feature extraction module is designed. By connecting and interacting heat maps of different resolving power in parallel, the heat map always maintains a higher resolving power for higher precision. It extracts the two-dimensional human pose from a single perspective, and then uses the multi-view information fusion technology proposed in this paper to complete and correct the pose information from different perspectives to obtain a more accurate two-dimensional pose. Then, through the camera pose transformation, the three-dimensional human pose estimation is realized, and the experimental verification is carried out on the multi-eye machine vision pan-tilt zoom tracking shooting system.

源语言英语
主期刊名Optical Metrology and Inspection for Industrial Applications IX
编辑Sen Han, Sen Han, Gerd Ehret, Benyong Chen
出版商SPIE
ISBN(电子版)9781510657045
DOI
出版状态已出版 - 2022
活动Optical Metrology and Inspection for Industrial Applications IX 2022 - Virtual, Online, 中国
期限: 5 12月 202211 12月 2022

出版系列

姓名Proceedings of SPIE - The International Society for Optical Engineering
12319
ISSN(印刷版)0277-786X
ISSN(电子版)1996-756X

会议

会议Optical Metrology and Inspection for Industrial Applications IX 2022
国家/地区中国
Virtual, Online
时期5/12/2211/12/22

指纹

探究 '3d human pose estimation based on multi view information fusion' 的科研主题。它们共同构成独一无二的指纹。

引用此