Abstract:Objective(s) To determine if gender differences exist in letters of recommendation for Reproductive Endocrinology and Infertility fellowship. Design Cohort study Setting Academic medical center Subjects Cohort of applicants to a reproductive endocrinology and infertility fellowship program at single Midwestern academic institution in a single year. Intervention(s) None Main Outcome Measure Quantitative measures included linguistics inquiry and word count analysis, with four summary variables and twenty-five word categories, to quantify tone and themes present by gender. Performing qualitative analysis in parallel to linguistic analysis allowed for exploration of themes not conveyed in quantitative methods alone. Qualitative measures included frequency of code themes in letters of recommendation by applicant gender. Result(s) There were 272 letters from 72 applicants, 54 (76%) of which were women and 17 (24%) were men. One applicant was excluded because gender information was not specified; 269 letters were included in the quantitative linguistics and qualitative coding analysis. One hundred ten letters (41%) were written by women, and 159 (59%) by men. Letters of recommendation written for men had higher mean word count than those written for women (537 vs 474, p=0.04). Linguistics Inquiry and Word Count analysis exhibited more risk words used to describe men applicants (p=0.01). When comparing word categories by letter writer gender, women letter writers more frequently used communal, affect, and home word categories while men writers more frequently used affiliation-related words. Qualitative analysis revealed that letters for men applicants described leadership, altruism, rapport with patients, and strong endorsements more frequently, while women applicants' letters more often mentioned doubt raisers and disclosures of personal life. Additionally, letters for women applicants more often described candidates as drama-free, not easy to "fluster," and not complainers. Further, letters for women more frequently disclosed parenthood status. Conclusion(s) Gender differences exist among both letter writers and applicants. Qualitative analysis revealed that women applicants were more likely to be described with doubt raisers and personal life disclosures, while men were more likely to be described by their altruism and with a strong endorsement. Increasing bias awareness and implementing mitigation strategies would improve gender equity in letters of recommendation.

Approaches to address bias in letters of recommendation

Decoding the Reference Letter: Strategies to Reduce Unintentional Gender Bias in Letters of Recommendation

Editor's Spotlight/Take 5: How Prominent Are Gender Bias, Racial Bias, and Score Inflation in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Racial and Ethnic Bias in Letters of Recommendation in Academic Medicine: A Systematic Review

Identifying Gender and Racial Bias in Pediatric Fellowship Letters of Recommendation: Do Word Choices Influence Interview Decisions?

Racial and Gender Discrimination in Hand Surgery Letters of Recommendation

Pearls and pitfalls in letters of recommendation for neurology residency applications

"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters

Assessing Gender Bias in Particle Physics and Social Science Recommendations for Academic Jobs

Gender bias in reference letters for residency and academic medicine: a systematic review

Let’s Face It: We Are Biased, and It Should Not Be That Way

Examining Implicit Bias Differences in Pediatric Surgical Fellowship Letters of Recommendation Using Natural Language Processing

Gender and culture bias in letters of recommendation for computer science and data science masters programs

Bias Perpetuates Bias: ChatGPT Learns Gender Inequities in Academic Surgery Promotions

Reply to the Letter to the Editor: How Prominent Are Gender Bias, Racial Bias, and Score Inflation in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Words Used in Letters of Recommendation for Pediatric Residency Applicants: Demographic Differences and Impact on Interviews

Do Gender Differences Exist in Letters of Recommendation for Reproductive Endocrinology and Infertility Fellowship?

Biases in Scholarly Recommender Systems: Impact, Prevalence, and Mitigation

Linguistic analysis of letters of recommendation for pediatric otolaryngology: A pilot study

How Prominent Is Score Inflation, Gender, and Racial Bias in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Gender bias in academia: A lifetime problem that needs solutions