PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 7, 20250 citationsOpen Access

DualNeRF: Text-Driven 3D Scene Editing via Dual-Field Representation

View Full Paper
YXYuxuan XiongYSYue ShiYDYishun Dou

Key Points

  • DualNeRF effectively maintains background quality in 3D scene editing, enhancing visual appeal and accuracy.
  • By introducing a dual-field representation, DualNeRF preserves original scene features, improving overall editing quality.
  • Through a simulated annealing strategy, DualNeRF addresses local optima issues, leading to better optimization during the editing process.
  • Extensive experiments show that DualNeRF outperforms previous methods in both qualitative and quantitative assessments.

Abstract

Recently, denoising diffusion models have achieved promising results in 2D image generation and editing. Instruct-NeRF2NeRF (IN2N) introduces the success of diffusion into 3D scene editing through an "Iterative dataset update" (IDU) strategy. Though achieving fascinating results, IN2N suffers from problems of blurry backgrounds and trapping in local optima. The first problem is caused by IN2N's lack of efficient guidance for background maintenance, while the second stems from the interaction between image editing and NeRF training during IDU. In this work, we introduce DualNeRF to deal with these problems. We propose a dual-field representation to preserve features of the original scene and utilize them as additional guidance to the model for background maintenance during IDU. Moreover, a simulated annealing strategy is embedded into IDU to endow our model with the power of addressing local optima issues. A CLIP-based consistency indicator is used to further improve the editing quality by filtering out low-quality edits. Extensive experiments demonstrate that our method outperforms previous methods both qualitatively and quantitatively.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Xiong et al. (2025) studied this question.

synapsesocial.com/papers/68e5a0557f330f793683f19chttps://doi.org/10.48550/arxiv.2502.16302
Ask AI
Helpful
Bookmark
Share
View Full Paper