Abstract:The use of Large Language Models (LLMs) in hiring has led to legislative actions to protect vulnerable demographic groups. This paper presents a novel framework for benchmarking hierarchical gender hiring bias in Large Language Models (LLMs) for resume scoring, revealing significant issues of reverse gender hiring bias and overdebiasing. Our contributions are fourfold: Firstly, we introduce a new construct grounded in labour economics, legal principles, and critiques of current bias benchmarks: hiring bias can be categorized into two types: Level bias (difference in the average outcomes between demographic counterfactual groups) and Spread bias (difference in the variance of outcomes between demographic counterfactual groups); Level bias can be further subdivided into statistical bias (i.e. changing with non-demographic content) and taste-based bias (i.e. consistent regardless of non-demographic content). Secondly, the framework includes rigorous statistical and computational hiring bias metrics, such as Rank After Scoring (RAS), Rank-based Impact Ratio, Permutation Test, and Fixed Effects Model. Thirdly, we analyze gender hiring biases in ten state-of-the-art LLMs. Seven out of ten LLMs show significant biases against males in at least one industry. An industry-effect regression reveals that the healthcare industry is the most biased against males. Moreover, we found that the bias performance remains invariant with resume content for eight out of ten LLMs. This indicates that the bias performance measured in this paper might apply to other resume datasets with different resume qualities. Fourthly, we provide a user-friendly demo and resume dataset to support the adoption and practical use of the framework, which can be generalized to other social traits and tasks.

Evaluating Gender, Racial, and Age Biases in Large Language Models: A Comparative Analysis of Occupational and Crime Scenarios

Gender bias and stereotypes in Large Language Models

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Revealing Hidden Bias in AI: Lessons from Large Language Models

Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implications

Evaluating and Addressing Demographic Disparities in Medical Large Language Models: A Systematic Review

Measuring Gender and Racial Biases in Large Language Models

Evaluation of Bias Towards Medical Professionals in Large Language Models

Gender Bias in Large Language Models across Multiple Languages

JobFair: A Framework for Benchmarking Gender Hiring Bias in Large Language Models

White Men Lead, Black Women Help? Benchmarking Language Agency Social Biases in LLMs

The Silicon Ceiling: Auditing GPT's Race and Gender Biases in Hiring

Evaluation of Large Language Models: STEM education and Gender Stereotypes

Large Language Models Portray Socially Subordinate Groups as More Homogeneous, Consistent with a Bias Observed in Humans

Evaluating Gender Bias of LLMs in Making Morality Judgements

How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?

Are Emily and Greg Still More Employable than Lakisha and Jamal? Investigating Algorithmic Hiring Bias in the Era of ChatGPT

Hire Me or Not? Examining Language Model's Behavior with Occupation Attributes

Protected group bias and stereotypes in Large Language Models

Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models