4D Facial Capture Pipeline Incorporating Progressive Retopology Approach

Zeyu Tian, Dongdong Weng*, Hui Fang, Hanzhi Guo, Yihua Bao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The pipeline for creating high-fidelity facial models often utilizes multi-view stereo techniques for reconstruction. However, the sub-sequent step of retopology often involves intricate manual work, limiting the extension of facial capture systems towards 4D acquisition. This paper proposes a facial 4D capture pipeline based on high-speed cameras. We employ standard multi-view stereo techniques for 3D reconstruction. Non-linear deformations of facial expressions are decoupled from rigid movements of the skull using QR code markers. Additionally, a progressive automated retopology approach is introduced for batch processing. Results demonstrate that our system can capture continuous facial motion sequences with detailed 3D models.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages741-742
Number of pages2
ISBN (Electronic)9798350374490
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 - Orlando, United States
Duration: 16 Mar 202421 Mar 2024

Publication series

NameProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024

Conference

Conference2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
Country/TerritoryUnited States
CityOrlando
Period16/03/2421/03/24

Keywords

  • Animation
  • Artificial intelligence
  • Computer graphics
  • Computer vision
  • Computing methodologies
  • Image and video acquisitio
  • Motion capture; Computing methodologies

Fingerprint

Dive into the research topics of '4D Facial Capture Pipeline Incorporating Progressive Retopology Approach'. Together they form a unique fingerprint.

Cite this