Automatic segmentation of human depth map based on semantic segmentation of fcn and depth segmentation

Ruifeng Yuan, Mei Hui, Ming Liu*, Yuejin Zhao, Liquan Dong, Lingqin Kong, Ming Chang, Zhi Cai

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Traditional 3D information acquisition of human body relies on either foreground extraction or threshold segmentation in a plain background. It is difficult to be applied directly in complex background. In this paper, a novel method is proposed on the basis of binocular vision, which combines the semantic segmentation of FCN with the depth segmentation to get the human body depth map. The depth map is obtained by binocular camera, and each point in the depth map corresponds to the point in the left camera image. The position of the human body is gained through semantic segmentation of the left camera image, then automatic depth segmentation can be conducted based on the depth of human body in the depth map. The final result is obtained by taking the intersection of the depth map segmentation result and the left camera image segmentation result. The results show that the segmentation precision is much higher than that of purely semantic segmentation of FCN, the segmentation accuracy has increased about 2%.

Original languageEnglish
Title of host publicationTenth International Conference on Digital Image Processing, ICDIP 2018
EditorsJenq-Neng Hwang, Xudong Jiang
PublisherSPIE
ISBN (Print)9781510621992
DOIs
Publication statusPublished - 2018
Event10th International Conference on Digital Image Processing, ICDIP 2018 - Shanghai, China
Duration: 11 May 201814 May 2018

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10806
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference10th International Conference on Digital Image Processing, ICDIP 2018
Country/TerritoryChina
CityShanghai
Period11/05/1814/05/18

Keywords

  • Depth map
  • Fully convolutional networks
  • Human body
  • Semantic segmentation

Fingerprint

Dive into the research topics of 'Automatic segmentation of human depth map based on semantic segmentation of fcn and depth segmentation'. Together they form a unique fingerprint.

Cite this