Abstract:The recent advancement of large and powerful models with Text-to-Image (T2I) generation abilities -- such as OpenAI's DALLE-3 and Google's Gemini -- enables users to generate high-quality images from textual prompts. However, it has become increasingly evident that even simple prompts could cause T2I models to exhibit conspicuous social bias in generated images. Such bias might lead to both allocational and representational harms in society, further marginalizing minority groups. Noting this problem, a large body of recent works has been dedicated to investigating different dimensions of bias in T2I systems. However, an extensive review of these studies is lacking, hindering a systematic understanding of current progress and research gaps. We present the first extensive survey on bias in T2I generative models. In this survey, we review prior studies on dimensions of bias: Gender, Skintone, and Geo-Culture. Specifically, we discuss how these works define, evaluate, and mitigate different aspects of bias. We found that: (1) while gender and skintone biases are widely studied, geo-cultural bias remains under-explored; (2) most works on gender and skintone bias investigated occupational association, while other aspects are less frequently studied; (3) almost all gender bias works overlook non-binary identities in their studies; (4) evaluation datasets and metrics are scattered, with no unified framework for measuring biases; and (5) current mitigation methods fail to resolve biases comprehensively. Based on current limitations, we point out future research directions that contribute to human-centric definitions, evaluations, and mitigation of biases. We hope to highlight the importance of studying biases in T2I systems, as well as encourage future efforts to holistically understand and tackle biases, building fair and trustworthy T2I technologies for everyone.

Mitigating Social Biases in Text-to-Image Diffusion Models Via Linguistic-Aligned Attention Guidance

MIST: Mitigating Intersectional Bias with Disentangled Cross-Attention Editing in Text-to-Image Diffusion Models

Exploring Social Bias in Downstream Applications of Text-to-Image Foundation Models

Bias Begets Bias: The Impact of Biased Embeddings on Diffusion Models

MoESD: Mixture of Experts Stable Diffusion to Mitigate Gender Bias

VersusDebias: Universal Zero-Shot Debiasing for Text-to-Image Models via SLM-Based Prompt Engineering and Generative Adversary

Latent Directions: A Simple Pathway to Bias Mitigation in Generative AI

Debiasing Text-to-Image Diffusion Models

New Job, New Gender? Measuring the Social Bias in Image Generation Models

Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigation

Debiasing Classifiers by Amplifying Bias with Latent Diffusion and Large Language Models

Gender Bias Evaluation in Text-to-image Generation: A Survey

BIGbench: A Unified Benchmark for Social Bias in Text-to-Image Generative Models Based on Multi-modal LLM

GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models

TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Models

AITTI: Learning Adaptive Inclusive Token for Text-to-Image Generation

Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness

Manipulating and Mitigating Generative Model Biases without Retraining

OpenBias: Open-set Bias Detection in Text-to-Image Generative Models

Quantifying Bias in Text-to-Image Generative Models