Abstract:This study explores bias in AI‐simulated otolaryngology residency selection committees (RSC) by analyzing selection decisions for residency applicants differentiated only by race, gender, and sexual orientation using a publicly available large language model (LLM), Open AI's GPT‐4. Results from simulated RSCs of diverse demographics reveal patterns of significant biases, with some selection preferences mirroring the RSC members' own racial and gender identities, as well as other hierarchies of bias prevalent in society. The findings show that utilizing publicly available LLMs to aid in otolaryngology residency selection may introduce racial, gender, and sexual orientation bias, and the significant potential for bias should be appreciated and minimized to ensure an equitable and diverse field of future otolaryngologists. Objectives To investigate potential demographic bias in artificial intelligence (AI)‐based simulations of otolaryngology, residency selection committee (RSC) members tasked with selecting one applicant among candidates with varied racial, gender, and sexual orientations. Methods This study employed random sampling of simulated RSC member decisions using a novel Application Programming Interface (API) to virtually connect to OpenAI's Generative Pre‐Trained Transformers (GPT‐4 and GPT‐4o). Simulated RSC members with diverse demographics were tasked with ranking to match 1 applicant among 10 with varied racial, gender, and sexual orientations. All applicants had identical qualifications; only demographics of the applicants and RSC members were varied for each simulation. Each RSC simulation ran 1000 times. Chi‐square tests analyzed differences across categorical variables. GPT‐4o simulations additionally requested a rationale for each decision. Results Simulated RSCs consistently showed racial, gender, and sexual orientation bias. Most applicant pairwise comparisons showed statistical significance (p 95% of such decisions. Conclusion Utilizing publicly available LLMs to aid in otolaryngology residency selection may introduce significant racial, gender, and sexual orientation bias. Potential for significant and evolving LLM bias should be appreciated and minimized to promote a diverse and representative field of future otolaryngologists in alignment with current workforce data. Level of Evidence N/A Laryngoscope, 2024

Large Language Models in Otolaryngology Residency Admissions: A Random Sampling Analysis

Evaluation of Bias Towards Medical Professionals in Large Language Models

Evaluating and Addressing Demographic Disparities in Medical Large Language Models: A Systematic Review

Measuring Gender and Racial Biases in Large Language Models

Fairness in AI-Driven Oncology: Investigating Racial and Gender Biases in Large Language Models

Linguistic analysis of letters of recommendation for pediatric otolaryngology: A pilot study

Gender Bias in Artificial Intelligence-Written Letters of Reference

Revealing Hidden Bias in AI: Lessons from Large Language Models

The Silicon Ceiling: Auditing GPT's Race and Gender Biases in Hiring

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Large Language Model Use in Radiology Residency Applications: Unwelcomed but Inevitable

Evaluating Gender, Racial, and Age Biases in Large Language Models: A Comparative Analysis of Occupational and Crime Scenarios

Assessing the potential of GPT-4 to perpetuate racial and gender biases in health care: a model evaluation study

Racial and Ethnic Disparities in Otolaryngology Applicants and Residents: Recruiting a Diverse Workforce

Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender?

Evaluating Anti-LGBTQIA+ Medical Bias in Large Language Models

Bias patterns in the application of LLMs for clinical decision support: A comprehensive study

Coding Inequity: Assessing GPT-4's Potential for Perpetuating Racial and Gender Biases in Healthcare

Identifying Gender and Racial Bias in Pediatric Fellowship Letters of Recommendation: Do Word Choices Influence Interview Decisions?

How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?

ChatGPT Exhibits Gender and Racial Biases in Acute Coronary Syndrome Management