Spacecraft-NeRF: High-Fidelity Reconstruction of Spacecraft by Neural Radiance Field Based Implicit Representation

Access to the appearance and geometry of spacecraft is one of the key points for conducting on-orbit services. However, without prior information, most contemporary methods still collect raw data from active sensors and then carry out a series of complex reconstruction processes. Therefore, simple and tractable methods for high-fidelity spacecraft reconstruction and rendering remain challenging in the current on-orbit services. Recently, neural radiance field-based implicit representation has demonstrated outstanding performance in a variety of reconstruction tasks. In this work, we focus on the fundamental needs in maintenance and fault diagnosis in on-orbit service: 1) 2-D view synthesis, and 2) 3-D model reconstruction, and propose a high-fidelity reconstruction method, Spacecraft-NeRF. It masks out the complex background content in the outdoor scenario with mask images generated by the segment anything model, solves the sampling and rendering problems with the L_{\infty } norm construction and a small proposal MLP, and improves the reconstruction quality via a hybrid encoding strategy. Based on simulated satellites, we collected and published a dataset, Spacecraft-3D, consisting of four types of spacecraft with different surface textures and geometric structures. In this dataset, Spacecraft-NeRF demonstrates realistic rendering performance, with extracted 3-D mesh models effectively represent the complex mechanical and geometrical structures. Compared with a series of reconstruction models, our method outperforms most baseline methods in terms of PSNR, SSIM, and LPIPS metrics.