Skip to main navigation Skip to search Skip to main content

Triplane Neural Fields from Unposed Sparse-Views for 3D Reconstruction and Mesh Colorization

  • Rama Bastola Neupane
  • , Zhuqing Mao
  • , Bayu Nadya Kusuma
  • , Kan Li*
  • *Corresponding author for this work
  • Beijing Institute of Technology
  • Tribhuvan University

Research output: Contribution to journal › Article › peer-review

Abstract

Reconstructing high-fidelity 3D geometry and appearance from sparse-view images is challenging when reliable camera poses are unavailable. Existing sparse-view methods typically assume known intrinsics/extrinsics or rely on explicit pose estimation, which reduces practical applicability and increases pipeline complexity. Moreover, mesh colorization is often handled as a separate task, despite per-vertex color being a standard representation of surface-aligned attributes in scientific and engineering workflows. We propose TNF-US, a unified pose-free framework that predicts a triplane neural field directly from a sparse set of RGB images, enabling both NeRF-style novel-view synthesis and mesh colorization in a single feed-forward model. Cross-view dense correspondences are distilled into per-view geometric descriptors that modulate ViT image tokens. The conditioned multi-view tokens are fused and decoded into triplanes that act as a shared latent for volumetric rendering and direct vertex queries. Training combines photometric supervision with vertex-color regression and a point-sampled density regularizer to stabilize geometry and encourage surface-consistent appearance. Experiments on Google Scanned Objects and OmniObject3D demonstrate consistent improvements over strong baselines, achieving up to 6.7% PSNR gain and 47.8% LPIPS reduction on novel-view evaluation, and up to 72% lower vertex-color error for mesh colorization.

Original languageEnglish
JournalIEEE Transactions on Visualization and Computer Graphics
DOIs
Publication statusAccepted/In press - 2026
Externally publishedYes

Keywords

  • 3D Reconstruction
  • Mesh Colorization
  • Neural Fields
  • Sparse-view
  • Triplane

Fingerprint

Dive into the research topics of 'Triplane Neural Fields from Unposed Sparse-Views for 3D Reconstruction and Mesh Colorization'. Together they form a unique fingerprint.

Cite this