Abstract:The rapid deployment of generative language models (LMs) has raised concerns about social biases affecting the well-being of diverse consumers. The extant literature on generative LMs has primarily examined bias via explicit identity prompting. However, prior research on bias in earlier language-based technology platforms, including search engines, has shown that discrimination can occur even when identity terms are not specified explicitly. Studies of bias in LM responses to open-ended prompts (where identity classifications are left unspecified) are lacking and have not yet been grounded in end-consumer harms. Here, we advance studies of generative LM bias by considering a broader set of natural use cases via open-ended prompting. In this "laissez-faire" setting, we find that synthetically generated texts from five of the most pervasive LMs (ChatGPT3.5, ChatGPT4, Claude2.0, Llama2, and PaLM2) perpetuate harms of omission, subordination, and stereotyping for minoritized individuals with intersectional race, gender, and/or sexual orientation identities (AI/AN, Asian, Black, Latine, MENA, NH/PI, Female, Non-binary, Queer). We find widespread evidence of bias to an extent that such individuals are hundreds to thousands of times more likely to encounter LM-generated outputs that portray their identities in a subordinated manner compared to representative or empowering portrayals. We also document a prevalence of stereotypes (e.g. perpetual foreigner) in LM-generated outputs that are known to trigger psychological harms that disproportionately affect minoritized individuals. These include stereotype threat, which leads to impaired cognitive performance and increased negative self-perception. Our findings highlight the urgent need to protect consumers from discriminatory harms caused by language models and invest in critical AI education programs tailored towards empowering diverse consumers.

A Simple, Yet Effective Approach to Finding Biases in Code Generation

Uncovering and Quantifying Social Biases in Code Generation

Bias Assessment and Mitigation in LLM-based Code Generation

Bias Testing and Mitigation in LLM-based Code Generation

Exploring Multi-Lingual Bias of Large Code Models in Code Generation

Bias and Error Mitigation in Software-Generated Data: An Advanced Search and Optimization Framework Leveraging Generative Code Models

Bias Unveiled: Investigating Social Bias in LLM-Generated Code

Biased or Flawed? Mitigating Stereotypes in Generative Language Models by Addressing Task-Specific Flaws

Mitigating Gender Bias in Code Large Language Models via Model Editing

CodeBenchGen: Creating Scalable Execution-based Code Generation Benchmarks

Towards Understanding and Mitigating Social Biases in Language Models

Imperfect Code Generation: Uncovering Weaknesses in Automatic Code Generation by Large Language Models

Assessing Bias in Metric Models for LLM Open-Ended Generation Bias Benchmarks

Bias in Generative AI

Exposing Bias in Online Communities through Large-Scale Language Models

Large Language Models and Simple, Stupid Bugs

Uncovering Weaknesses in Neural Code Generation

Laissez-Faire Harms: Algorithmic Biases in Generative Language Models

How Readable is Model-generated Code? Examining Readability and Visual Inspection of GitHub Copilot

Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approach