Human-in-the-Loop Gaussian Model Enhancement with Mobile Robotic Re-Capture

Xiaonuo Dongye, Hanzhi Guo, Yihua Bao, Haiyan Jiang, Dongdong Weng*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

3D Gaussian Splatting can create virtual models with captured real-world images using a camera mounted on a mobile robotic arm. However, the Gaussian model quality deteriorates when parts of the object that have not been previously captured are exposed in VR interaction. This poster presents a human-in-the-loop Gaussian model enhancement method, comprising pre-training, viewpoint labeling, robotic image re-capture, and Gaussian model enhancement. By incorporating newly re-captured images, the enhanced models achieve improved image similarity metrics compared to the pre-trained ones, with minimal optimization time. This method facilitates continuous quality improvement, making Gaussian models more adaptable for VR applications.

Original languageEnglish
Title of host publicationProceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1336-1337
Number of pages2
ISBN (Electronic)9798331514846
DOIs
Publication statusPublished - 2025
Event2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025 - Saint-Malo, France
Duration: 8 Mar 202512 Mar 2025

Publication series

NameProceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025

Conference

Conference2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
Country/TerritoryFrance
CitySaint-Malo
Period8/03/2512/03/25

Keywords

  • Computing methodologies Computer graphics→Rendering
  • Point-based models

Fingerprint

Dive into the research topics of 'Human-in-the-Loop Gaussian Model Enhancement with Mobile Robotic Re-Capture'. Together they form a unique fingerprint.

Cite this