3D reconstruction of typical entities based on multi-perspective images

Haiyun Liang, Ming Liu*, Mei Hui, Yuejin Zhao, Liquan Dong, Lingqin Kong

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

With the progress of technology, 3D printing technology has gradually developed and matured, and has been widely used in aerospace, game artifacts, medical industry and heritage conservation. As a reverse engineering technology of 3D printing, 3D reconstruction technology can reconstruct a 3D mesh model from several images of typical target entities. Monocular 3D reconstruction has the advantages of easy access and low cost. Therefore, this paper improves a multiview stereo reconstruction technique based on monocular camera: DC-MVSNet. Firstly, the collected multi-view images are sparse reconstructed by colmap to obtain sparse point clouds and camera poses. Then, it is input into DC-MVSNet network and output to get the depth map corresponding to the reference image. Finally, the 3D point cloud model is obtained by deep fusion. In the feature extraction module and depth map refinement module, a densenet and a coordinate attention mechanism are added respectively to improve the feature extraction ability. The proposed method is compared with previous works. The results show that the reconstruction completeness of the algorithm for weakly textured objects is improved in both objective quantitative indexes and subjective perception. The study can be deployed on win10, linux and embedded systems, working reliably and practically. It is of significant reference value for 3D printing reverse engineering.

Original languageEnglish
Title of host publicationOptical Metrology and Inspection for Industrial Applications IX
EditorsSen Han, Sen Han, Gerd Ehret, Benyong Chen
PublisherSPIE
ISBN (Electronic)9781510657045
DOIs
Publication statusPublished - 2022
EventOptical Metrology and Inspection for Industrial Applications IX 2022 - Virtual, Online, China
Duration: 5 Dec 202211 Dec 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12319
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceOptical Metrology and Inspection for Industrial Applications IX 2022
Country/TerritoryChina
CityVirtual, Online
Period5/12/2211/12/22

Keywords

  • attention mechanism
  • densenet module
  • monocular vision system
  • multi-view stereo

Fingerprint

Dive into the research topics of '3D reconstruction of typical entities based on multi-perspective images'. Together they form a unique fingerprint.

Cite this