Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinking

Yue Fu,Han Bin,Tony Zhou,Marx Wang,Yixin Chen,Zelia Gomes Da Costa Lai,Jacob O. Wobbrock,Alexis Hiniker

2024-11-01

Abstract:As generative AI (GenAI) increasingly permeates design workflows, its impact on design outcomes and designers' creative capabilities warrants investigation. We conducted a within-subjects experiment where we asked participants to design advertisements both with and without GenAI support. Our results show that expert evaluators rated GenAI-supported designs as more creative and unconventional ("weird") despite no significant differences in visual appeal, brand alignment, or usefulness, which highlights the decoupling of novelty from usefulness-traditional dual components of creativity-in the context of GenAI usage. Moreover, while GenAI does not significantly enhance designers' overall creative thinking abilities, users were affected differently based on native language and prior AI exposure. Native English speakers experienced reduced relaxation when using AI, whereas designers new to GenAI exhibited gains in divergent thinking, such as idea fluency and flexibility. These findings underscore the variable impact of GenAI on different user groups, suggesting the potential for customized AI tools.

Human-Computer Interaction,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is whether generative artificial intelligence (Generative AI, GenAI) creative support tools can truly enhance the creativity of designers, and how these tools affect design output and the experience of designers in doing design work. Specifically, the research proposes the following three research questions:

1. **RQ1**: Do these generative AI creative support tools really fulfill their promise of enhancing the creativity of designers?
2. **RQ2**: If so, how do they affect design output?
3. **RQ3**: What is their impact on the experience of designers in doing design work, especially on the designers' emotions, internal creativity and self - efficacy?

To explore these questions, the researchers designed an experiment and invited 36 designers from different backgrounds to participate. The participants were required to complete a common practical design task: creating promotional materials for a social media advertising campaign to promote the client's organization. The experiment was divided into two phases, and in each phase, the participants were required to design advertisements with and without GenAI support respectively. All participants completed the design tasks in both phases, and the order of conditions was balanced to control for order effects.

Through this experimental design, the research aims to evaluate the impact of GenAI on the creativity, practicality, visual attractiveness, brand consistency of design output, as well as the internal creativity, emotional state and self - efficacy of designers. The research results show that expert reviewers believe that designs with GenAI support are more creative and unconventional ("weird"), but there are no significant differences in perceived practicality, visual attractiveness or brand performance. In addition, the use of GenAI has no significant overall impact on the internal creativity, emotions or self - efficacy of designers, but there are differences in the impact on different subgroups (such as whether they have previous experience in using GenAI tools and whether their mother tongue is English).