Abstract:We evaluated fluvial geomorphology‐specific biases in the training data and downstream performance of popular text‐to‐image model Stable Diffusion. Beyond Western biases, training data overrepresented scenic locations and showed unequal representation of morphological and environmental terms. Despite limitations, the model was able to generate photorealistic river images through careful prompting. Summary Text‐to‐image (TTI) generative models can be used to generate photorealistic images from a given text‐string input. However, the rapid increase in their use has raised questions about fairness and biases, with most research to date focusing on social and cultural areas rather than domain‐specific considerations. We conducted a case study for the Earth sciences, focusing on the field of fluvial geomorphology, where we evaluated subject‐area‐specific biases in the training data and downstream model performance of Stable Diffusion (v1.5). In addition to perpetuating Western biases, we found that the training data overrepresented scenic locations, such as famous rivers and waterfalls, and showed serious underrepresentation and overrepresentation of many morphological and environmental terms. Despite biassed training data, we found that with careful prompting, the Stable Diffusion model was able to generate photorealistic synthetic river images reproducing many important environmental and morphological characteristics. Furthermore, conditional control techniques, such as the use of condition maps with ControlNet, were effective for providing additional constraints on output images. Despite great potential for the use of TTI models in the Earth sciences field, we advocate for caution in sensitive applications and advocate for domain‐specific reviews of training data and image generation biases to mitigate perpetuation of existing biases.

DiffusionWorldViewer: Exposing and Broadening the Worldview Reflected by Generative Text-to-Image Models

Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Models

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Models

Debiasing Text-to-Image Diffusion Models

Civiverse: A Dataset for Analyzing User Engagement with Open-Source Text-to-Image Models

The Hidden Language of Diffusion Models

Diversity and Diffusion: Observations on Synthetic Image Distributions with Stable Diffusion

Stable rivers: A case study in the application of text‐to‐image generative models for Earth sciences

Interactive Visual Learning for Stable Diffusion

Diffusion Lens: Interpreting Text Encoders in Text-to-Image Pipelines

Visual Concept-driven Image Generation with Text-to-Image Diffusion Model

Create Your World: Lifelong Text-to-Image Diffusion

DiffusionGPT: LLM-Driven Text-to-Image Generation System

AltDiffusion: A Multilingual Text-to-Image Diffusion Model

WorldGPT: A Sora-Inspired Video AI Agent as Rich World Models from Text and Image Inputs

Text-to-Image Representativity Fairness Evaluation Framework

Diverse Diffusion: Enhancing Image Diversity in Text-to-Image Generation

DiffBlender: Scalable and Composable Multimodal Text-to-Image Diffusion Models

If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selection

Stable Bias: Analyzing Societal Representations in Diffusion Models