Abstract:Background: Letters of recommendation for Maternal-Fetal Medicine(MFM) fellowship are a critical part of the applicant selection process. However, data regarding best practices for how to write LOR for MFM is limited. Similarly, within letters of recommendation, differences in the "code" or meaning of summative words/phrases used at the end of letters of recommendation are seen between surgery, pediatrics, and medicine. However, data regarding code MFM Letters of recommendation are quite limited. Objective: We sought to describe what Maternal-Fetal Medicine program directors value in letters of recommendation for fellowship applicants and how PDs interpret commonly used summative words/phrases. Study design: After IRB exemption, subject matter experts developed an e-survey querying the importance of various letters of recommendation "best practices" described by other specialties. Content and face validation were performed prior to dissemination. This cross-sectional survey was administered to MFM program directors in February 2023. The primary outcome was the relative importance of letters of recommendation content areas. Secondary outcomes included the strength of each summative "code" phrase. Descriptive analysis was performed and principal component analysis (PCA) was then used to reduce the list of phrases to their underlying dimensions. Statistical analysis was performed by SPSS 29.0. Results: Of 104 MFM program directors sent the survey, 70 (67%) responded. MFM program directors reviewed an average of 78 applications (SD, 30) with 60% writing ≥3 letters/year. Ninety-one percent of respondents noted that letters of recommendation are important/very important in shaping impressions of an applicant. Respondents reported the depth of interaction with an applicant, the applicant's specific behavior traits, the applicant's abilities and a summative statement including strength of the recommendation as important content for MFM fellowship letters of recommendation. Letter length, use of bold/italics, and restating the applicant's curriculum vitae were considered not important. Following PCA with varimax rotation, 14 specific phrases used in letters of recommendation were reduced to 5 themes: high qualitative assessments, average qualitative assessments, objective metrics, exceeding expectations and grit. These themes accounted for 64.6% of the variance in the model (KMO 0.7, Bartlett's Test of Sphericity p<.01). Phrases that respondents considered positive included: "Top 5%," "Want to keep," and "highest recommendation," (all mean score≥4.5/5), while "expected level," "showed improvement," and "2nd quartile" were negatively associated code words (all mean score <2.5/5). Conclusion: MFM program directors reported that descriptions of an applicant's abilities, behavior traits, and depth of the writer's interactions with the applicant were all important components of an MFM fellowship letters of recommendation. Letter length, bold/italics, and highlights from the CV were not important. A clear "code" emerged regarding summative phrases included in letters of recommendation. Dissemination of these data might help less experienced letter writers send a clearer message and ensure all letter writers have a shared mental model.

Writing Effective Letters of Recommendation in Physiology

Pearls and pitfalls in letters of recommendation for neurology residency applications

Letters of Reference in the Current Era

Components of effective letters of recommendation: A cross-sectional survey of academic faculty

Attitudes towards and impact of letters of recommendation for anesthesiology residency applicants

On the Use of Letters of Recommendation in Astronomy and Astrophysics Graduate Admissions

Best Practices for Writing Letters of Recommendation for Maternal-Fetal Medicine Fellowship: An Empty Scoping Review

Reference letters for subspecialty medicine residency positions: are they valuable for decision-making? Results from a Canadian study

Letter of Recommendation Characteristics Associated with Interview Offer to a Vascular Surgery Residency Program

A novel faculty development tool for writing a letter of recommendation

Cracking the code: interpreting content and phrases used in maternal-fetal medicine fellowship letters of recommendation

Effectiveness of pre-admission data and letters of recommendation to predict students who will need professional behavior intervention during clinical rotations in the United States

Racial and Gender Discrimination in Hand Surgery Letters of Recommendation

Editor's Spotlight/Take 5: How Prominent Are Gender Bias, Racial Bias, and Score Inflation in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Formal degree programs in physiology promote careers of clinical scientists and benefit basic science departments

A Primer: Peer Review Process for Advances in Physiology Education

Decoding the Reference Letter: Strategies to Reduce Unintentional Gender Bias in Letters of Recommendation

Physiologists as medical scientists: An early warning from the German academic system

How Prominent Is Score Inflation, Gender, and Racial Bias in Orthopaedic Surgery Residency Recommendation Letters? A Systematic Review

Doing peer review and receiving feedback: impact on scientific literacy and writing skills

Gender Bias in Letters of Recommendation: Relevance to Urology Match Outcomes and Pursuit of Fellowship Training/Academic Career