The transition from conceptual sketch to 3D model poses a major challenge in engineering design. While Mixed Reality (MR) enables direct 3D creation, designers face two key challenges: the Initiation Challenge (lack of meaningful starting points) and the Expression Challenge (difficulty in precise mid-air sketching). We introduce Generative Surface, leveraging AI to translate natural language descriptions into interactive 3D surfaces that aid designers in 3D sketching, simultaneously addressing both challenges. Our system transforms the design workflow into a fluid "describe, generate, sketch, iterate" cycle. Comparative evaluation against primitive scaffolding and freehand mid-air sketching demonstrates that our approach effectively bridges the gap between designers' conceptual intent and 3D sketch expression in immersive environments.
Chai et al. (Thu,) studied this question.