PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 7, 20250 citationsOpen Access

Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Control

View Full Paper
JYJinbo YanAZA.P. ZhaoYHYixin Hu

Key Points

  • Dragen3D enables geometrically consistent 3D generation, enhancing usability in various applications.
  • This method demonstrates comparable 3D generation quality to state-of-the-art approaches while ensuring user control.
  • The Seed-Point-Driven strategy allows intuitive manipulation of 3D geometry, improving accessibility for users.
  • The Anchor-GS VAE encodes 3D structures effectively, providing a foundation for high-quality 3D Gaussian generation.

Abstract

Single-image 3D generation has emerged as a prominent research topic, playing a vital role in virtual reality, 3D modeling, and digital content creation. However, existing methods face challenges such as a lack of multi-view geometric consistency and limited controllability during the generation process, which significantly restrict their usability. % To tackle these challenges, we introduce Dragen3D, a novel approach that achieves geometrically consistent and controllable 3D generation leveraging 3D Gaussian Splatting (3DGS). We introduce the Anchor-Gaussian Variational Autoencoder (Anchor-GS VAE), which encodes a point cloud and a single image into anchor latents and decode these latents into 3DGS, enabling efficient latent-space generation. To enable multi-view geometry consistent and controllable generation, we propose a Seed-Point-Driven strategy: first generate sparse seed points as a coarse geometry representation, then map them to anchor latents via the Seed-Anchor Mapping Module. Geometric consistency is ensured by the easily learned sparse seed points, and users can intuitively drag the seed points to deform the final 3DGS geometry, with changes propagated through the anchor latents. To the best of our knowledge, we are the first to achieve geometrically controllable 3D Gaussian generation and editing without relying on 2D diffusion priors, delivering comparable 3D generation quality to state-of-the-art methods.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yan et al. (2025) studied this question.

synapsesocial.com/papers/68e5a0557f330f793683f318https://doi.org/10.48550/arxiv.2502.16475
Ask AI
Helpful
Bookmark
Share
View Full Paper