Abstract:The use of Large Language Models (LLMs) in hiring has led to legislative actions to protect vulnerable demographic groups. This paper presents a novel framework for benchmarking hierarchical gender hiring bias in Large Language Models (LLMs) for resume scoring, revealing significant issues of reverse gender hiring bias and overdebiasing. Our contributions are fourfold: Firstly, we introduce a new construct grounded in labour economics, legal principles, and critiques of current bias benchmarks: hiring bias can be categorized into two types: Level bias (difference in the average outcomes between demographic counterfactual groups) and Spread bias (difference in the variance of outcomes between demographic counterfactual groups); Level bias can be further subdivided into statistical bias (i.e. changing with non-demographic content) and taste-based bias (i.e. consistent regardless of non-demographic content). Secondly, the framework includes rigorous statistical and computational hiring bias metrics, such as Rank After Scoring (RAS), Rank-based Impact Ratio, Permutation Test, and Fixed Effects Model. Thirdly, we analyze gender hiring biases in ten state-of-the-art LLMs. Seven out of ten LLMs show significant biases against males in at least one industry. An industry-effect regression reveals that the healthcare industry is the most biased against males. Moreover, we found that the bias performance remains invariant with resume content for eight out of ten LLMs. This indicates that the bias performance measured in this paper might apply to other resume datasets with different resume qualities. Fourthly, we provide a user-friendly demo and resume dataset to support the adoption and practical use of the framework, which can be generalized to other social traits and tasks.

Tie-breaker: Using language models to quantify gender bias in sports journalism

Gender Bias in Large Language Models across Multiple Languages

Quantifying gender bias towards politicians in cross-lingual language models

Measuring Gender and Racial Biases in Large Language Models

Are Models Biased on Text without Gender-related Language?

Unveiling Gender Bias in Large Language Models: Using Teacher's Evaluation in Higher Education As an Example

Locating and Mitigating Gender Bias in Large Language Models

Does Debiasing Inevitably Degrade the Model Performance

JobFair: A Framework for Benchmarking Gender Hiring Bias in Large Language Models

Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventions

Automatic Classification of News Subjects in Broadcast News: Application to a Gender Bias Representation Analysis

Gender byline bias in sports reporting: Examining the visibility and audience perception of male and female journalists in sports coverage

Deuce or advantage? Examining gender bias in online coverage of professional tennis

Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias

Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models

Gender bias and stereotypes in Large Language Models

Unraveling Downstream Gender Bias from Large Language Models: A Study on AI Educational Writing Assistance

Leveraging Large Language Models to Measure Gender Representation Bias in Gendered Language Corpora

Does Gender Matter in the News? Detecting and Examining Gender Bias in News Articles