Key points are not available for this paper at this time.
This paper proposes a novel scalable image-based rendering (IBR) pipeline for indoor scenes with reflections. We make substantial progress towards three sub-problems in IBR, namely, depth and reflection reconstruction, view selection for temporally coherent view-warping, and smooth rendering refinements. First, we introduce a global-mesh-guided alternating optimization algorithm that robustly extracts a two-layer geometric representation. The front and back layers encode the RGB-D reconstruction and the reflection reconstruction, respectively. This representation minimizes the image composition error under novel views, enabling accurate renderings of reflections. Second, we introduce a novel approach to select adjacent views and compute blending weights for smooth and temporal coherent renderings. The third contribution is a supersampling network with a motion vector rectification module that refines the rendering results to improve the final output's temporal coherence. These three contributions together lead to a novel system that produces highly realistic rendering results with various reflections. The rendering quality outperforms state-of-the-art IBR or neural rendering algorithms considerably.
Building similarity graph...
Analyzing shared references across papers
Loading...
Jiamin Xu
Central South University
Xiuchao Wu
Zhejiang University
Zihan Zhu
Fudan University
ACM Transactions on Graphics
The University of Texas at Austin
Zhejiang University
Clemson University
Building similarity graph...
Analyzing shared references across papers
Loading...
Xu et al. (Mon,) studied this question.
synapsesocial.com/papers/6a0d4d1968ddba849a09b0e7 — DOI: https://doi.org/10.1145/3450626.3459849
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: