User study demonstrates that an interactive knowledge graph improves design concept exploration in novice designers, suggesting enhanced ideation with LLMs.
Large language models (LLMs) are capable of generating cross-domain design knowledge, opening up new possibilities for creating a myriad of design concepts for early-stage design ideation. However, the current chat-based interface fails to represent the complexity of the design space, leading to design fixation or information overload for designers. To address this, we present ConceptVis, a system that organizes and symbiotically coordinates the LLM-generated design space through an interactive knowledge graph. In ConceptVis, designers can easily visualize the structure of the design space, track the generated concepts, and explore new concepts by intuitively prompting the LLM from existing nodes. Our system aims to support users in exploring a design space in both breadth and depth to ensure the diversity and quality of the generated concepts. We conducted a user study with 24 novice designers and compared the performance of ConceptVis with that of a chat-based LLM interface for concept generation. From the user study, we observed that the system prevents users from routinely prompting the LLM and receiving similar concepts. Instead, they were encouraged to take advantage of popular design methods and execute them efficiently with the help of the LLM. The results illustrate that supporting users in interacting with LLMs through an interactive knowledge graph can significantly enhance the user experience and improve their performance in early-stage ideation. We also highlight the importance of developing human-centered systems that leverage the power of LLMs to facilitate productive human-AI collaboration.
No takes yet. Share an insight, caveat, or question.
Duan et al. (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: