Abstract:The recent advancement of large and powerful models with Text-to-Image (T2I) generation abilities -- such as OpenAI's DALLE-3 and Google's Gemini -- enables users to generate high-quality images from textual prompts. However, it has become increasingly evident that even simple prompts could cause T2I models to exhibit conspicuous social bias in generated images. Such bias might lead to both allocational and representational harms in society, further marginalizing minority groups. Noting this problem, a large body of recent works has been dedicated to investigating different dimensions of bias in T2I systems. However, an extensive review of these studies is lacking, hindering a systematic understanding of current progress and research gaps. We present the first extensive survey on bias in T2I generative models. In this survey, we review prior studies on dimensions of bias: Gender, Skintone, and Geo-Culture. Specifically, we discuss how these works define, evaluate, and mitigate different aspects of bias. We found that: (1) while gender and skintone biases are widely studied, geo-cultural bias remains under-explored; (2) most works on gender and skintone bias investigated occupational association, while other aspects are less frequently studied; (3) almost all gender bias works overlook non-binary identities in their studies; (4) evaluation datasets and metrics are scattered, with no unified framework for measuring biases; and (5) current mitigation methods fail to resolve biases comprehensively. Based on current limitations, we point out future research directions that contribute to human-centric definitions, evaluations, and mitigation of biases. We hope to highlight the importance of studying biases in T2I systems, as well as encourage future efforts to holistically understand and tackle biases, building fair and trustworthy T2I technologies for everyone.

Partiality and Misconception: Investigating Cultural Representativeness in Text-to-Image Models

On the Cultural Gap in Text-to-Image Generation

Beyond Aesthetics: Cultural Competence in Text-to-Image Models

Towards Equitable Representation in Text-to-Image Synthesis Models with the Cross-Cultural Understanding Benchmark (CCUB) Dataset

TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Models

Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Models

Stable Bias: Analyzing Societal Representations in Diffusion Models

Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigation

Text-to-Image Representativity Fairness Evaluation Framework

Quantifying Bias in Text-to-Image Generative Models

BIGbench: A Unified Benchmark for Social Bias in Text-to-Image Generative Models Based on Multi-modal LLM

AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asia

Mitigating Social Biases in Text-to-Image Diffusion Models Via Linguistic-Aligned Attention Guidance

T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation

Lost in Translation? Translation Errors and Challenges for Fair Assessment of Text-to-Image Models on Multilingual Concepts

Uncurated Image-Text Datasets: Shedding Light on Demographic Bias

Evaluating Text-to-Image Generative Models: An Empirical Study on Human Image Synthesis

GRADE: Quantifying Sample Diversity in Text-to-Image Models

Bias Begets Bias: The Impact of Biased Embeddings on Diffusion Models

Debiasing Text-to-Image Diffusion Models