Abstract:Phenomenon: Professionalism is integral to the role of the physician. Most professionalism assessments in medical training are delayed until clinical rotations where multisource feedback is available. This leaves a gap in student assessment portfolios and potentially delays professional development. Approach: A total of 246 second-year medical students (2013-2015) completed self- and peer assessments of professional behaviors in 2 courses following a series of Team-Based Learning exercises. Correlation and regression analyses were used to examine the alignment or misalignment in the relationship between the 2 types of assessments. Four subgroups were formed based on observed patterns of initial self- and peer assessment alignment or misalignment, and subgroup membership stability over time was assessed. A missing data analysis examined differences between average peer assessment scores as a function of selective nonparticipation. Findings: Spearman correlation demonstrated moderate to strong correlation between self-assessments completed alone (no simultaneous peer assessment) and self-assessments completed at the time of peer assessments ( = .59, p < .0001) but weak correlation between the two self-assessments and peer assessments (alone: = .13, p < .013; at time of peer: = .21, p < .0001). Generalized estimating equation models revealed that self-assessments done alone (p < .0001) were a significant predictor of self-assessments done at the time of peer. Course was also a significant predictor (p = .01) of self-assessment scores done at the time of peer. Peer assessment score was not a significant predictor. Bhapkar's test revealed subgroup membership based on the relationship between self- and peer ratings was relatively stable across Time 1 and Time 2 assessments ((2) = 0.83, p = .84) for all but one subgroup; members of the subgroup with initially high self-assessment and low peer assessment were significantly more likely to move to a new classification at the second measurement. A missing data analysis revealed that students who completed all self-assessments had significantly higher average peer assessment ratings compared to students who completed one or no self-assessments with a difference of -0.32, 95% confidence interval [-0.48, -0.15]. Insights: Multiple measurements of simultaneous self- and peer assessment identified a subgroup of students who consistently rated themselves higher on professionalism attributes relative to the low ratings given by their peers. This subgroup of preclinical students, along with those who elected to not complete self-assessments, may be at risk for professionalism concerns. Use of this multisource feedback tool to measure perceptual stability of professionalism behaviors is a new approach that may assist with early identification of at-risk students during preclinical years.

Effects of Behavioral Anchors on Peer Evaluation Reliability

Peer Evaluation Instrument Development, Administration, and Assessment in a Team-based Learning Curriculum

Peer assessment, self-assessment, and resultant feedback: an examination of feasibility and reliability

Engaging Software Engineering Students in Grading: The effects of peer assessment on self-evaluation, motivation, and study time

A comparison of the validity of two instruments assessing health professional student perceptions of interprofessional education and practice

The effects of peer judgements on teamwork and self-assessment ability in collaborative group work

Improving the peer interactions of students with emotional and behavioral disorders through self-evaluation procedures: a component analysis and group application

Using Continuous Peer Evaluation in Team-Based Engineering Capstone Projects: A Case Study

Impact of scaffolding and hands-on assignments within mechatronics on student learning outcomes of KEEN's entrepreneurial mindset

Assessment as Learning: How Does Peer Assessment Function in Students' Learning?

A Three-Year Study on Peer Evaluation in a Software Engineering Project Course

Peer Assessment Between Students in Colleges and Universities

The Anchoring Effect in Study Time Allocation: Labor-in-Vain versus Labor-and-Gain

A Novel Approach to Assessing Professionalism in Preclinical Medical Students Using Multisource Feedback Through Paired Self- and Peer Evaluations

Students' Perceptions of Peer Evaluation: An Expectancy Perspective

Multirater Feedback of Leadership of Underrepresented Groups in a Civil Engineering Capstone Design Course

Peer assessment enhances student learning

The Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group Studies

A systematic review on peer assessment: intrapersonal and interpersonal factors

Does peer assessment promote student learning? A meta-analysis

The Effect of Peer Assessment on Non-Cognitive Outcomes: A Meta-Analysis