Abstract:The recent advancement of large and powerful models with Text-to-Image (T2I) generation abilities -- such as OpenAI's DALLE-3 and Google's Gemini -- enables users to generate high-quality images from textual prompts. However, it has become increasingly evident that even simple prompts could cause T2I models to exhibit conspicuous social bias in generated images. Such bias might lead to both allocational and representational harms in society, further marginalizing minority groups. Noting this problem, a large body of recent works has been dedicated to investigating different dimensions of bias in T2I systems. However, an extensive review of these studies is lacking, hindering a systematic understanding of current progress and research gaps. We present the first extensive survey on bias in T2I generative models. In this survey, we review prior studies on dimensions of bias: Gender, Skintone, and Geo-Culture. Specifically, we discuss how these works define, evaluate, and mitigate different aspects of bias. We found that: (1) while gender and skintone biases are widely studied, geo-cultural bias remains under-explored; (2) most works on gender and skintone bias investigated occupational association, while other aspects are less frequently studied; (3) almost all gender bias works overlook non-binary identities in their studies; (4) evaluation datasets and metrics are scattered, with no unified framework for measuring biases; and (5) current mitigation methods fail to resolve biases comprehensively. Based on current limitations, we point out future research directions that contribute to human-centric definitions, evaluations, and mitigation of biases. We hope to highlight the importance of studying biases in T2I systems, as well as encourage future efforts to holistically understand and tackle biases, building fair and trustworthy T2I technologies for everyone.

Quantifying Bias in Text-to-Image Generative Models

TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Models

Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigation

GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models

BIGbench: A Unified Benchmark for Social Bias in Text-to-Image Generative Models Based on Multi-modal LLM

Manipulating and Mitigating Generative Model Biases without Retraining

Analyzing Quality, Bias, and Performance in Text-to-Image Generative Models

T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation

Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Models

Bias Begets Bias: The Impact of Biased Embeddings on Diffusion Models

On the Fairness, Diversity and Reliability of Text-to-Image Generative Models

A Taxonomy of the Biases of the Images created by Generative Artificial Intelligence

Stable Bias: Analyzing Societal Representations in Diffusion Models

OpenBias: Open-set Bias Detection in Text-to-Image Generative Models

Text-to-Image Representativity Fairness Evaluation Framework

Gender Bias Evaluation in Text-to-image Generation: A Survey

Mitigating Social Biases in Text-to-Image Diffusion Models Via Linguistic-Aligned Attention Guidance

New Job, New Gender? Measuring the Social Bias in Image Generation Models

Evaluating Text-to-Image Generative Models: An Empirical Study on Human Image Synthesis

VersusDebias: Universal Zero-Shot Debiasing for Text-to-Image Models via SLM-Based Prompt Engineering and Generative Adversary