Abstract:Objective(s) To determine if gender differences exist in letters of recommendation for Reproductive Endocrinology and Infertility fellowship. Design Cohort study Setting Academic medical center Subjects Cohort of applicants to a reproductive endocrinology and infertility fellowship program at single Midwestern academic institution in a single year. Intervention(s) None Main Outcome Measure Quantitative measures included linguistics inquiry and word count analysis, with four summary variables and twenty-five word categories, to quantify tone and themes present by gender. Performing qualitative analysis in parallel to linguistic analysis allowed for exploration of themes not conveyed in quantitative methods alone. Qualitative measures included frequency of code themes in letters of recommendation by applicant gender. Result(s) There were 272 letters from 72 applicants, 54 (76%) of which were women and 17 (24%) were men. One applicant was excluded because gender information was not specified; 269 letters were included in the quantitative linguistics and qualitative coding analysis. One hundred ten letters (41%) were written by women, and 159 (59%) by men. Letters of recommendation written for men had higher mean word count than those written for women (537 vs 474, p=0.04). Linguistics Inquiry and Word Count analysis exhibited more risk words used to describe men applicants (p=0.01). When comparing word categories by letter writer gender, women letter writers more frequently used communal, affect, and home word categories while men writers more frequently used affiliation-related words. Qualitative analysis revealed that letters for men applicants described leadership, altruism, rapport with patients, and strong endorsements more frequently, while women applicants' letters more often mentioned doubt raisers and disclosures of personal life. Additionally, letters for women applicants more often described candidates as drama-free, not easy to "fluster," and not complainers. Further, letters for women more frequently disclosed parenthood status. Conclusion(s) Gender differences exist among both letter writers and applicants. Qualitative analysis revealed that women applicants were more likely to be described with doubt raisers and personal life disclosures, while men were more likely to be described by their altruism and with a strong endorsement. Increasing bias awareness and implementing mitigation strategies would improve gender equity in letters of recommendation.

Reply to the Letter to the Editor: How Prominent Are Gender Bias, Racial Bias, and Score Inflation in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

How Prominent Is Score Inflation, Gender, and Racial Bias in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Editor's Spotlight/Take 5: How Prominent Are Gender Bias, Racial Bias, and Score Inflation in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Racial and Gender Discrimination in Hand Surgery Letters of Recommendation

Evaluating the 2023 Standardized Letter of Recommendation Form in Applications to Orthopaedic Surgery Residency

Dear Program Director: An Evaluation of Implicit Bias in Letters of Recommendation for Neurosurgery Residency

Racial and Ethnic Bias in Letters of Recommendation in Academic Medicine: A Systematic Review

Gender bias in colorectal surgery fellowship letters of recommendation

Gender bias in reference letters for residency and academic medicine: a systematic review

Gender Bias in Letters of Recommendation: Relevance to Urology Match Outcomes and Pursuit of Fellowship Training/Academic Career

Assessment of Gender Differences in Letters of Recommendation for Physical Therapy Residency Applications

Identifying Gender and Racial Bias in Pediatric Fellowship Letters of Recommendation: Do Word Choices Influence Interview Decisions?

Linguistic analysis of letters of recommendation for pediatric otolaryngology: A pilot study

Do Gender Differences Exist in Letters of Recommendation for Reproductive Endocrinology and Infertility Fellowship?

Examining Implicit Bias Differences in Pediatric Surgical Fellowship Letters of Recommendation Using Natural Language Processing

Decoding the Reference Letter: Strategies to Reduce Unintentional Gender Bias in Letters of Recommendation

Words Used in Letters of Recommendation for Pediatric Residency Applicants: Demographic Differences and Impact on Interviews

Gender bias in postgraduate year one pharmacy letters of recommendation

Evaluating the Impact of the Standardized Letter of Recommendation on a Successful Match in Urology Residency

Attitudes towards and impact of letters of recommendation for anesthesiology residency applicants

Approaches to address bias in letters of recommendation