The role of interface design on prompt-mediated creativity in Generative AI

Maddalena Torricelli,Mauro Martino,Andrea Baronchelli,Luca Maria Aiello

2024-02-17

Abstract:Generative AI for the creation of images is becoming a staple in the toolkit of digital artists and visual designers. The interaction with these systems is mediated by \emph{prompting}, a process in which users write a short text to describe the desired image's content and style. The study of prompts offers an unprecedented opportunity to gain insight into the process of human creativity. Yet, our understanding of how people use them remains limited. We analyze more than 145,000 prompts from the logs of two Generative AI platforms (Stable Diffusion and Pick-a-Pic) to shed light on how people \emph{explore} new concepts over time, and how their exploration might be influenced by different design choices in human-computer interfaces to Generative AI. We find that users exhibit a tendency towards exploration of new topics over exploitation of concepts visited previously. However, a comparative analysis of the two platforms, which differ both in scope and functionalities, reveals some stark differences. Features diverting user focus from prompting and providing instead shortcuts for quickly generating image variants are associated with a considerable reduction in both exploration of novel concepts and detail in the submitted prompts. These results carry direct implications for the design of human interfaces to Generative AI and raise new questions regarding how the process of prompting should be aided in ways that best support creativity.

Computers and Society,Human-Computer Interaction,Physics and Society

What problem does this paper attempt to address?

This paper attempts to address issues primarily focused on how the interface design of Generative AI affects user creativity. Specifically, the study explores the following two key questions by analyzing over 145,000 text prompts on two generative AI platforms (Stable Diffusion and Pick-a-Pic):

1. **To what extent do users explore different concepts in the process of creating generative art?**
- The study examines whether users tend to explore new themes or repeatedly use existing concepts.

2. **How do generative AI tools with different designs facilitate or hinder this exploration?**
- The study compares the design differences between the two platforms and their impact on user exploration behavior.

The research found that users generally tend to explore new themes rather than repeat old concepts. However, when the platform provides a feature that allows quick generation of image variants without modifying the prompts, users' exploration behavior significantly decreases, and the submitted prompts become shorter. These findings have direct implications for designing human-computer interaction interfaces for generative AI and raise new questions about how to assist users in interacting with AI in ways that best support creativity.