Abstract:<section class="article-section__content"><h3 class="article-section__sub-title section1"> Background</h3><p>Research shows that female trainees experience evaluation penalties for gender non-conforming behavior during medical training. Studies of medical education evaluations and performance scores do reflect a gender bias, though studies are of varying methodology and results have not been consistent.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Objective</h3><p>We sought to examine the differences in word use, competency themes, and length within written evaluations of internal medicine residents at scale, considering the impact of both faculty and resident gender.</p><p>We hypothesized that female internal medicine residents receive more negative feedback, and different thematic feedback than male residents.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Methods</h3><p>This study utilized a corpus of 3864 individual responses to positive and negative questions over the course of six years (2012-2018) within Yale University School of Medicine's internal medicine residency. Researchers developed a sentiment model to assess the valence of evaluation responses. We then used natural language processing (NLP) to evaluate whether female versus male residents received more positive or negative feedback and if that feedback focused on different Accreditation Council for Graduate Medical Education (ACGME) core competencies based on their gender. Evaluator-evaluatee gender dyad was analyzed to see how it impacted quantity and quality of feedback.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Results</h3><p>We found that female and male residents did not have substantively different numbers of positive or negative comments. While certain competencies were discussed more than others, gender did not seem to influence which competencies were discussed. Neither gender trainee received more written feedback, though female evaluators tended to write longer evaluations.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Conclusions</h3><p>We conclude that when examined at scale, quantitative gender differences are not as prevalent as has been seen in qualitative work. We suggest that further investigation of linguistic phenomena (such as context) is warranted to reconcile this finding with prior work.</p></section>

Examining Gender Differences in Written Assessment Tasks in Biology: A Case Study of Evolutionary Explanations

Gender Differences in Introductory Atmospheric and Oceanic Science Exams: Multiple Choice Versus Constructed Response Questions

EXAMINING THE RELATIONSHIP OF CONTENT TO GENDER-BASED PERFORMANCE DIFFERENCES IN ADVANCED PLACEMENT EXAMS

How Do Students Critically Evaluate Outdated Language That Relates to Gender in Biology?

Gender Differences Under Test Pressure and Their Impact on Academic Performance: A Quasi-Experimental Design

Gender Differences in Clinical Performance Assessment of Internal Medicine Residents: A Longitudinal Analysis of the Influence of Faculty and Trainee Gender

Gender differences in reading and writing achievement: Evidence from the National Assessment of Educational Progress (NAEP).

Gender bias in resident evaluations: Natural language processing and competency evaluation

Test Fairness: Examining Differential Functioning of the Reading Comprehension Section of the GSEEE in China

Gender differences in conceptual understanding of Newtonian mechanics: a UK cross-institution comparison

Gender differences in peer review outcomes and manuscript impact at six journals of ecology and evolution

The gender difference in orienting liquid surfaces and plumb-lines: its robustness, its correlates, and the associated knowledge of simple physics

Gendered performance differences in introductory physics: A study from a large land-grant university

Testing the test: Are exams measuring understanding?

Science faculty’s subtle gender biases favor male students

Gender Differences in Class Participation in Core CS Courses

Examining high-school students’ overconfidence bias in biology exam: a focus on the effects of country and gender

Gender Differences in Student Participation in an Active-Learning Classroom

Sex differences on elementary cognitive tasks despite no differences on the Wonderlic Personnel Test

The impact of e-learning, gender-groupings and learning pedagogies in biology undergraduate female and male students’ attitudes and achievement

Gender Differences in Responses to Competitive Organization? A Field Experiment on Differences Between STEM and Non-STEM Fields from an Internet-of-Things Platform