Randomized trial demonstrates improved 3D inpainting quality in unbounded scenes, suggesting effective solutions for immersive environments.
Recent advances in NeRF-based inpainting have enabled the completion of masked regions across multi-view images. However, two major challenges remain: generating accurate masks efficiently in the presence of complex multi-object interference and maintaining view consistency without floating artifacts in large-scale, unbounded 360° environments. To address these challenges, we propose a 3D inpainting framework with two principal components. First, a depth-aware mask-generation pipeline produces high-quality, view-consistent masks from sparse annotations. Second, spherical parameterization is combined with a joint objective comprising smooth inter-layer and original-scene constraints to suppress floating artifacts and content drift in unbounded scenes. We also introduce IM2360, a multi-object 360° dataset for evaluating 3D inpainting methods. Experiments show that our approach outperforms existing NeRF-based inpainting methods in PSNR, LPIPS, and FID. On a single NVIDIA GeForce RTX 4090, our method requires an average of 25.21 min of training per scene, compared with 98.14 min for SPIn-NeRF, 38.71 min for OR-NeRF, and 11.29 min for InFusion. These results indicate that the proposed method provides a favorable balance between reconstruction quality and computational cost for high-fidelity restoration of complex immersive scenes.
No takes yet. Share an insight, caveat, or question.
Guo et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: