TriSpaSurf: A Triple-View Outline Guided 3D Surface Reconstruction of Vehicles from Sparse Point Cloud

Hanfeng Zheng, Huijun Di*, Yaohang Han, Jianwei Gong

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Vehicle is one of the important subjects studied in the domain of computer vision, autonomous driving and intelligent transportation system. 3D models of vehicles are used widely in the literature of vehicle categorization, pose estimation, detection, and tracking. However, previous work uses only a small set of 3D vehicle models either from CAD design or multi-view reconstruction, limiting their representation ability and performance. A feasible approach to acquire extensive 3D vehicle models is desired. In this paper, we are interested in 3D surface reconstruction of on-road vehicles from sparse point cloud captured by laser scanners equipped ubiquitously on autonomous driving platforms. We propose an innovative reconstruction pipeline and method, called TriSpaSurf, which could reconstruct unbroken and smooth surface robustly from just a single frame of noisy sparse point cloud. In the TriSpaSurf, triple-view 2D outlines are first fitted on the 2D points from the projection of 3D point cloud under each view, and then 2.5D surface reconstruction is carried out under the guidance from triple-view outlines. By projecting 3D point cloud onto 2D views, 2D outlines could be estimated robustly due to the reduced complexity and higher signal-to-noise ratio in 2D views, and could provide fairly stable and tight multi-view constraints for 3D surface reconstruction. The effectiveness of our method is verified on the KITTI and Sydney dataset.

Original languageEnglish
Title of host publicationPattern Recognition and Computer Vision - 3rd Chinese Conference, PRCV 2020, Proceedings
EditorsYuxin Peng, Hongbin Zha, Qingshan Liu, Huchuan Lu, Zhenan Sun, Chenglin Liu, Xilin Chen, Jian Yang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages398-409
Number of pages12
ISBN (Print)9783030606329
DOIs
Publication statusPublished - 2020
Event3rd Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2020 - Nanjing, China
Duration: 16 Oct 202018 Oct 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12305 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2020
Country/TerritoryChina
CityNanjing
Period16/10/2018/10/20

Keywords

  • 2.5D representation
  • Surface reconstruction
  • Triple-View outline

Fingerprint

Dive into the research topics of 'TriSpaSurf: A Triple-View Outline Guided 3D Surface Reconstruction of Vehicles from Sparse Point Cloud'. Together they form a unique fingerprint.

Cite this