3d human pose estimation based on multi view information fusion

Shuo Zhang, Ming Liu*, Yuejin Zhao, Liquan Dong, Lingqin Kong

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

3D human pose estimation refers to recovering the pose of the human body in the three-dimensional space from the image, which is estimating the coordinates of the key points of the human body in the three-dimensional coordinate system. The human skeleton model composed of these keypoints describes the human pose in the image.The traditional pose estimation method uses motion capture equipment, which requires athletes to wear auxiliary equipment and affects the normal training of athletes. With the development of deep learning, convolutional neural network has shown strong representational capabilities in the process of image feature extraction, and is an effective method to achieve human pose estimation. However, in the actual complex and changeable three-dimensional space, the environment is noisy and the limbs are occluded. The monocular capture of human posture has the problems of low accuracy and instability, and cannot provide sufficient semantic information.To solve this poroblem, this paper designs a multi-view information fusion algorithm. First, a two-dimensional attitude feature extraction module is designed. By connecting and interacting heat maps of different resolving power in parallel, the heat map always maintains a higher resolving power for higher precision. It extracts the two-dimensional human pose from a single perspective, and then uses the multi-view information fusion technology proposed in this paper to complete and correct the pose information from different perspectives to obtain a more accurate two-dimensional pose. Then, through the camera pose transformation, the three-dimensional human pose estimation is realized, and the experimental verification is carried out on the multi-eye machine vision pan-tilt zoom tracking shooting system.

Original languageEnglish
Title of host publicationOptical Metrology and Inspection for Industrial Applications IX
EditorsSen Han, Sen Han, Gerd Ehret, Benyong Chen
PublisherSPIE
ISBN (Electronic)9781510657045
DOIs
Publication statusPublished - 2022
EventOptical Metrology and Inspection for Industrial Applications IX 2022 - Virtual, Online, China
Duration: 5 Dec 202211 Dec 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12319
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceOptical Metrology and Inspection for Industrial Applications IX 2022
Country/TerritoryChina
CityVirtual, Online
Period5/12/2211/12/22

Keywords

  • Computer Vision
  • Information Fusion
  • Pose Conversion
  • Pose Estimation
  • Tracking Shooting

Fingerprint

Dive into the research topics of '3d human pose estimation based on multi view information fusion'. Together they form a unique fingerprint.

Cite this