Abstract:Phenomenon: Professionalism is integral to the role of the physician. Most professionalism assessments in medical training are delayed until clinical rotations where multisource feedback is available. This leaves a gap in student assessment portfolios and potentially delays professional development. Approach: A total of 246 second-year medical students (2013-2015) completed self- and peer assessments of professional behaviors in 2 courses following a series of Team-Based Learning exercises. Correlation and regression analyses were used to examine the alignment or misalignment in the relationship between the 2 types of assessments. Four subgroups were formed based on observed patterns of initial self- and peer assessment alignment or misalignment, and subgroup membership stability over time was assessed. A missing data analysis examined differences between average peer assessment scores as a function of selective nonparticipation. Findings: Spearman correlation demonstrated moderate to strong correlation between self-assessments completed alone (no simultaneous peer assessment) and self-assessments completed at the time of peer assessments ( = .59, p < .0001) but weak correlation between the two self-assessments and peer assessments (alone: = .13, p < .013; at time of peer: = .21, p < .0001). Generalized estimating equation models revealed that self-assessments done alone (p < .0001) were a significant predictor of self-assessments done at the time of peer. Course was also a significant predictor (p = .01) of self-assessment scores done at the time of peer. Peer assessment score was not a significant predictor. Bhapkar's test revealed subgroup membership based on the relationship between self- and peer ratings was relatively stable across Time 1 and Time 2 assessments ((2) = 0.83, p = .84) for all but one subgroup; members of the subgroup with initially high self-assessment and low peer assessment were significantly more likely to move to a new classification at the second measurement. A missing data analysis revealed that students who completed all self-assessments had significantly higher average peer assessment ratings compared to students who completed one or no self-assessments with a difference of -0.32, 95% confidence interval [-0.48, -0.15]. Insights: Multiple measurements of simultaneous self- and peer assessment identified a subgroup of students who consistently rated themselves higher on professionalism attributes relative to the low ratings given by their peers. This subgroup of preclinical students, along with those who elected to not complete self-assessments, may be at risk for professionalism concerns. Use of this multisource feedback tool to measure perceptual stability of professionalism behaviors is a new approach that may assist with early identification of at-risk students during preclinical years.

Comparison of peer, self, and faculty objective structured clinical examination evaluations in a PharmD nonprescription therapeutics course

A comparison between student performances on objective structured clinical examination and virtual simulation

Do students' self-reflections of performance align with their graded performance in objective structured clinical exams?

Evaluating student performance assessment methods in Objective Structured Clinical Exam: perspectives and comparisons

R.I.M.E. and reason: multi-station OSCE enhancement to neutralize grade inflation

Evaluating the Role of Objective Structured Clinical Examination as a Summative Assessment Tool in Undergraduate and Postgraduate Psychiatry Residents

Stress and value: the student perspective on utilizing real vs. actor patients in objective structured clinical examinations

The opinion of post graduate students on objective structured clinical examination in Anaesthesiology: A preliminary report

Using modified information delivery to enhance the traditional pharmacy OSCE program at TMU - a pilot study

Determining Grades in the Internal Medicine Clerkship: Results of a National Survey of Clerkship Directors

A peer-led mock OSCE improves student confidence for summative OSCE assessments in a traditional medical course

Inter-school variations in the standard of examiners' graduation-level OSCE judgements

Impact of tablet-scoring and immediate score sheet review on validity and educational impact in an internal medicine residency Objective Structured Clinical Exam (OSCE)

Implementation and evaluation of objective structured clinical examination for eight-year program medical students of clinical medicine in clerkship

Peers as OSCE assessors for junior medical students - a review of routine use: a mixed methods study

Perception of undergraduate medical students and examiners towards grand objective structured clinical examination

Evaluation of online OSCE (objective structured clinical examination) for understanding drug management cycle in pre-registered pharmacist education

Linking assessment to real life practice – comparing work based assessments and objective structured clinical examinations using mystery shopping

The Electronic Health Record Objective Structured Clinical Examination Station: Assessing Student Competency in Patient Notes and Patient Interaction

Medical Students’ Perception of a Newly Implemented Objective Structured Clinical Examination (OSCE) in Orthopedic Surgery and Trauma: A Mixed-Method Study

A Novel Approach to Assessing Professionalism in Preclinical Medical Students Using Multisource Feedback Through Paired Self- and Peer Evaluations