Interaction Design with Generative AI: An Empirical Study of Emerging Strategies Across the Four Phases of Design

Marie Muehlhaus,Jürgen Steimle
2024-11-05
Abstract:Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this gap by investigating how Generative AI contributes to requirements elicitation, conceptual design, physical design, and evaluation. Based on empirical findings from a comprehensive eight-week study, we provide detailed empirical accounts and comparisons of successful strategies for diverse design activities across all key phases, along with recurring prompting patterns and challenges faced. Our results demonstrate that Generative AI can successfully support the designer in all key phases, but the generated outcomes require manual quality assessments. Further, our analysis revealed that the successful prompting patterns used to create or evaluate outcomes of design activities require different structures depending on the phase of the design and the specific design activity. We derive implications for designers and future tools that support interaction design with Generative AI.
Human-Computer Interaction
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to explore the application potential of generative artificial intelligence (Generative AI) in the four key stages of user - centered design (User - Centered Design, UCD). Specifically, the paper answers the following questions through empirical research: 1. **The role of generative AI in requirements elicitation**: - How to use generative AI to create personas and scenarios to better understand user needs and usage contexts. 2. **The role of generative AI in conceptual design**: - How to utilize generative AI to generate and evaluate design concepts, provide creative support, and conduct preliminary design verification. 3. **The role of generative AI in physical design**: - How to use generative AI to design prototypes, select components, and program hardware to support the development of physical devices. 4. **The role of generative AI in evaluation**: - How to utilize generative AI to design evaluation methods and experimental schemes, and how to identify and solve problems in experimental design. ### Main findings - **Effectiveness of generative AI**: Generative AI can provide effective support in all key stages of UCD, including creating design artifacts from scratch, iteratively improving existing artifacts, and collecting feedback on existing artifacts. However, the generated artifacts usually require manual refinement. - **Successful prompt patterns**: Different design stages and activities require different prompt structures. Early design stages benefit from single and highly structured prompts, while later design stages require iterative prompts. Feedback collection usually uses a single prompt that provides the least additional information. - **Challenges and limitations**: Participants face some challenges when using generative AI, such as stereotypical representations of users and scenarios in the early design stages, difficulties in generating functional designs in the later design stages, and ethical issues with using commercial generative AI tools. ### Conclusion This paper, through systematic empirical research, provides detailed insights and practical suggestions for the application of generative AI in interaction design. These findings help guide designers to use generative AI more effectively and promote innovative and efficient interaction system design practices.