PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 27, 2025IEEE Transactions on Image Processing32 citations

Deep Sparse-to-Dense Inbetweening for Multi-View Light Fields

View Full Paper
YMYifan MaoZXZeyu XiaoPAPing An

Key Points

  • Our method outperforms existing techniques, establishing new benchmarks for sparse-to-dense inbetweening.
  • The high-quality dataset includes 60 indoor and 59 outdoor scenes to support multi-view light field investigation.
  • Using an adaptive alignment module, the method captures dynamic information for better view synthesis between sparse inputs.
  • The artifact-aware loss function effectively reduces visual artifacts, increasing the integrity of the reconstructed light fields.

Abstract

Light field (LF) imaging, which captures both intensity and directional information of light rays, extends the capabilities of traditional imaging techniques. In this paper, we introduce a task in the field of LF imaging, sparse-to-dense inbetweening, which focuses on generating dense novel views from sparse multi-view LFs. By synthesizing intermediate views from sparse inputs, this task enhances LF view synthesis through filling in interperspective gaps within an expanded field of view and increasing data robustness by leveraging complementary information between light rays from different perspectives, which are limited by non-robust single-view synthesis and the inability to handle sparse inputs effectively. To address these challenges, we construct a high-quality multi-view LF dataset, consisting of 60 indoor scenes and 59 outdoor scenes. Building upon this dataset, we propose a baseline method. Specifically, we introduce an adaptive alignment module to dynamically align information by capturing relative displacements. Next, we explore angular consistency and hierarchical information using a multi-level feature decoupling module. Finally, a multi-level feature refinement module is applied to enhance features and facilitate reconstruction. Additionally, we introduce a universally applicable artifact-aware loss function to effectively suppress visual artifacts. Experimental results demonstrate that our method outperforms existing approaches, establishing a benchmark for sparse-to-dense inbetweening. The code is available at https://github.com/Starmao1/MutiLF.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Mao et al. (2025) studied this question.

synapsesocial.com/papers/68d7e84439bbb06045426b25https://doi.org/10.1109/tip.2025.3612257
Ask AI
Helpful
Bookmark
Share
View Full Paper