No Longer Trending on Artstation: Prompt Analysis of Generative AI Art

Jon McCormack,Maria Teresa Llano,Stephen James Krol,Nina Rajcic
2024-01-24
Abstract:Image generation using generative AI is rapidly becoming a major new source of visual media, with billions of AI generated images created using diffusion models such as Stable Diffusion and Midjourney over the last few years. In this paper we collect and analyse over 3 million prompts and the images they generate. Using natural language processing, topic analysis and visualisation methods we aim to understand collectively how people are using text prompts, the impact of these systems on artists, and more broadly on the visual cultures they promote. Our study shows that prompting focuses largely on surface aesthetics, reinforcing cultural norms, popular conventional representations and imagery. We also find that many users focus on popular topics (such as making colouring books, fantasy art, or Christmas cards), suggesting that the dominant use for the systems analysed is recreational rather than artistic.
Human-Computer Interaction,Artificial Intelligence,Computer Vision and Pattern Recognition,Computers and Society,Neural and Evolutionary Computing
What problem does this paper attempt to address?
The research paper primarily discusses the analysis of textual prompts in generative AI art, particularly focusing on image generation models such as Stable Diffusion and Midjourney. The study collected and analyzed over 3 million prompts and their generated images, using natural language processing, topic analysis, and visualization methods to understand how people use textual prompts, the impact of these systems on artists, and their broader influence on visual culture promotion. The research findings reveal that the prompts mainly concentrate on surface aesthetics, reinforcing cultural norms, popular conventional expressions, and images. Many users focus on popular themes such as making coloring books, fantasy art, or Christmas cards, indicating that the dominant purpose of these systems is entertainment rather than artistic creation. Additionally, there are instances of users imitating specific artistic styles and the generated images may reflect and reinforce cultural stereotypes. The paper demonstrates the changes in prompt language by comparing the dataset from mid-2022 to November 2023, and analyzes how these changes affect artistic practice and thinking. The study also addresses issues related to copyright, bias, artistic authenticity, and highlights the challenges that exist despite attempts to mitigate negative impacts. In summary, this paper aims to enhance our understanding of how generative AI influences visual art and culture by delving into the usage of textual prompts, and raises concerns regarding the potential cultural, ethical, and conceptual issues associated with this new technology.