Abstract:Background: Letters of recommendation for Maternal-Fetal Medicine(MFM) fellowship are a critical part of the applicant selection process. However, data regarding best practices for how to write LOR for MFM is limited. Similarly, within letters of recommendation, differences in the "code" or meaning of summative words/phrases used at the end of letters of recommendation are seen between surgery, pediatrics, and medicine. However, data regarding code MFM Letters of recommendation are quite limited. Objective: We sought to describe what Maternal-Fetal Medicine program directors value in letters of recommendation for fellowship applicants and how PDs interpret commonly used summative words/phrases. Study design: After IRB exemption, subject matter experts developed an e-survey querying the importance of various letters of recommendation "best practices" described by other specialties. Content and face validation were performed prior to dissemination. This cross-sectional survey was administered to MFM program directors in February 2023. The primary outcome was the relative importance of letters of recommendation content areas. Secondary outcomes included the strength of each summative "code" phrase. Descriptive analysis was performed and principal component analysis (PCA) was then used to reduce the list of phrases to their underlying dimensions. Statistical analysis was performed by SPSS 29.0. Results: Of 104 MFM program directors sent the survey, 70 (67%) responded. MFM program directors reviewed an average of 78 applications (SD, 30) with 60% writing ≥3 letters/year. Ninety-one percent of respondents noted that letters of recommendation are important/very important in shaping impressions of an applicant. Respondents reported the depth of interaction with an applicant, the applicant's specific behavior traits, the applicant's abilities and a summative statement including strength of the recommendation as important content for MFM fellowship letters of recommendation. Letter length, use of bold/italics, and restating the applicant's curriculum vitae were considered not important. Following PCA with varimax rotation, 14 specific phrases used in letters of recommendation were reduced to 5 themes: high qualitative assessments, average qualitative assessments, objective metrics, exceeding expectations and grit. These themes accounted for 64.6% of the variance in the model (KMO 0.7, Bartlett's Test of Sphericity p<.01). Phrases that respondents considered positive included: "Top 5%," "Want to keep," and "highest recommendation," (all mean score≥4.5/5), while "expected level," "showed improvement," and "2nd quartile" were negatively associated code words (all mean score <2.5/5). Conclusion: MFM program directors reported that descriptions of an applicant's abilities, behavior traits, and depth of the writer's interactions with the applicant were all important components of an MFM fellowship letters of recommendation. Letter length, bold/italics, and highlights from the CV were not important. A clear "code" emerged regarding summative phrases included in letters of recommendation. Dissemination of these data might help less experienced letter writers send a clearer message and ensure all letter writers have a shared mental model.

The content and value of letters of recommendation in the resident candidate evaluative process

Attitudes towards and impact of letters of recommendation for anesthesiology residency applicants

Letter of Recommendation Characteristics Associated with Interview Offer to a Vascular Surgery Residency Program

Letters of Reference in the Current Era

A novel faculty development tool for writing a letter of recommendation

Reference letters for subspecialty medicine residency positions: are they valuable for decision-making? Results from a Canadian study

Concordance of leadership documentation in curricula vitae and recommendation letters among applicants for general surgery residency

Dear Program Director: An Evaluation of Implicit Bias in Letters of Recommendation for Neurosurgery Residency

Words Used in Letters of Recommendation for Pediatric Residency Applicants: Demographic Differences and Impact on Interviews

Cracking the code: interpreting content and phrases used in maternal-fetal medicine fellowship letters of recommendation

Evaluating the 2023 Standardized Letter of Recommendation Form in Applications to Orthopaedic Surgery Residency

Sentiment analysis of letters of recommendation for a U.S. pain medicine fellowship from 2020 to 2023

Evaluating the Impact of the Standardized Letter of Recommendation on a Successful Match in Urology Residency

Best Practices for Writing Letters of Recommendation for Maternal-Fetal Medicine Fellowship: An Empty Scoping Review

Gender Bias in Letters of Recommendation: Relevance to Urology Match Outcomes and Pursuit of Fellowship Training/Academic Career

How Prominent Is Score Inflation, Gender, and Racial Bias in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Effectiveness of pre-admission data and letters of recommendation to predict students who will need professional behavior intervention during clinical rotations in the United States

A survey of criteria used to evaluate applications for small animal surgery residency positions

Best practices for PGY1 letters of intent: Recommendations from a modified Delphi process

Machine Learning for Predictive Analysis of Otolaryngology Residency Letters of Recommendation

Identifying Gender and Racial Bias in Pediatric Fellowship Letters of Recommendation: Do Word Choices Influence Interview Decisions?