Abstract:Objective(s) To determine if gender differences exist in letters of recommendation for Reproductive Endocrinology and Infertility fellowship. Design Cohort study Setting Academic medical center Subjects Cohort of applicants to a reproductive endocrinology and infertility fellowship program at single Midwestern academic institution in a single year. Intervention(s) None Main Outcome Measure Quantitative measures included linguistics inquiry and word count analysis, with four summary variables and twenty-five word categories, to quantify tone and themes present by gender. Performing qualitative analysis in parallel to linguistic analysis allowed for exploration of themes not conveyed in quantitative methods alone. Qualitative measures included frequency of code themes in letters of recommendation by applicant gender. Result(s) There were 272 letters from 72 applicants, 54 (76%) of which were women and 17 (24%) were men. One applicant was excluded because gender information was not specified; 269 letters were included in the quantitative linguistics and qualitative coding analysis. One hundred ten letters (41%) were written by women, and 159 (59%) by men. Letters of recommendation written for men had higher mean word count than those written for women (537 vs 474, p=0.04). Linguistics Inquiry and Word Count analysis exhibited more risk words used to describe men applicants (p=0.01). When comparing word categories by letter writer gender, women letter writers more frequently used communal, affect, and home word categories while men writers more frequently used affiliation-related words. Qualitative analysis revealed that letters for men applicants described leadership, altruism, rapport with patients, and strong endorsements more frequently, while women applicants' letters more often mentioned doubt raisers and disclosures of personal life. Additionally, letters for women applicants more often described candidates as drama-free, not easy to "fluster," and not complainers. Further, letters for women more frequently disclosed parenthood status. Conclusion(s) Gender differences exist among both letter writers and applicants. Qualitative analysis revealed that women applicants were more likely to be described with doubt raisers and personal life disclosures, while men were more likely to be described by their altruism and with a strong endorsement. Increasing bias awareness and implementing mitigation strategies would improve gender equity in letters of recommendation.

Gender-based linguistic differences in letters of recommendation for rhinology fellowship over time: A dual-institutional follow-up study using natural language processing and deep learning

Gender Differences in Letters of Recommendations and Personal Statements for Neurotology Fellowship over 10 Years: A Deep Learning Linguistic Analysis

Linguistic analysis of letters of recommendation for pediatric otolaryngology: A pilot study

Identifying Gender and Racial Bias in Pediatric Fellowship Letters of Recommendation: Do Word Choices Influence Interview Decisions?

Gender bias in colorectal surgery fellowship letters of recommendation

Dear Program Director: An Evaluation of Implicit Bias in Letters of Recommendation for Neurosurgery Residency

Gender bias in postgraduate year one pharmacy letters of recommendation

Gender Bias in Artificial Intelligence-Written Letters of Reference

Examining Implicit Bias Differences in Pediatric Surgical Fellowship Letters of Recommendation Using Natural Language Processing

Gender bias in reference letters for residency and academic medicine: a systematic review

Racial and Gender Discrimination in Hand Surgery Letters of Recommendation

Words Used in Letters of Recommendation for Pediatric Residency Applicants: Demographic Differences and Impact on Interviews

Do Gender Differences Exist in Letters of Recommendation for Reproductive Endocrinology and Infertility Fellowship?

Gender and culture bias in letters of recommendation for computer science and data science masters programs

Gender Differences in Self-Description: A Linguistic Analysis of Orthopedic Surgery Residency Application Personal Statements

Assessment of Gender Differences in Letters of Recommendation for Physical Therapy Residency Applications

Racial and Ethnic Bias in Letters of Recommendation in Academic Medicine: A Systematic Review

Bias Perpetuates Bias: ChatGPT Learns Gender Inequities in Academic Surgery Promotions

Machine Learning for Predictive Analysis of Otolaryngology Residency Letters of Recommendation

Gender Bias in Letters of Recommendation: Relevance to Urology Match Outcomes and Pursuit of Fellowship Training/Academic Career

Large Language Models in Otolaryngology Residency Admissions: A Random Sampling Analysis