Abstract:Phenomenon: Professionalism is integral to the role of the physician. Most professionalism assessments in medical training are delayed until clinical rotations where multisource feedback is available. This leaves a gap in student assessment portfolios and potentially delays professional development. Approach: A total of 246 second-year medical students (2013-2015) completed self- and peer assessments of professional behaviors in 2 courses following a series of Team-Based Learning exercises. Correlation and regression analyses were used to examine the alignment or misalignment in the relationship between the 2 types of assessments. Four subgroups were formed based on observed patterns of initial self- and peer assessment alignment or misalignment, and subgroup membership stability over time was assessed. A missing data analysis examined differences between average peer assessment scores as a function of selective nonparticipation. Findings: Spearman correlation demonstrated moderate to strong correlation between self-assessments completed alone (no simultaneous peer assessment) and self-assessments completed at the time of peer assessments ( = .59, p < .0001) but weak correlation between the two self-assessments and peer assessments (alone: = .13, p < .013; at time of peer: = .21, p < .0001). Generalized estimating equation models revealed that self-assessments done alone (p < .0001) were a significant predictor of self-assessments done at the time of peer. Course was also a significant predictor (p = .01) of self-assessment scores done at the time of peer. Peer assessment score was not a significant predictor. Bhapkar's test revealed subgroup membership based on the relationship between self- and peer ratings was relatively stable across Time 1 and Time 2 assessments ((2) = 0.83, p = .84) for all but one subgroup; members of the subgroup with initially high self-assessment and low peer assessment were significantly more likely to move to a new classification at the second measurement. A missing data analysis revealed that students who completed all self-assessments had significantly higher average peer assessment ratings compared to students who completed one or no self-assessments with a difference of -0.32, 95% confidence interval [-0.48, -0.15]. Insights: Multiple measurements of simultaneous self- and peer assessment identified a subgroup of students who consistently rated themselves higher on professionalism attributes relative to the low ratings given by their peers. This subgroup of preclinical students, along with those who elected to not complete self-assessments, may be at risk for professionalism concerns. Use of this multisource feedback tool to measure perceptual stability of professionalism behaviors is a new approach that may assist with early identification of at-risk students during preclinical years.

AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment

Struggles and Joys: A Mixed Methods Study of the Artefacts and Reflections in Medical Student Portfolios

[Use of a portfolio during the second cycle of medical studies in a urology department]

WEB-BASED 5-DIMENSIONAL ELECTRONIC PORTFOLIO (5DEP) AS A COMPETENCY-BASED ASSESSMENT TOOL IN POST-GRADUATE MEDICAL TRAINING

Learning portfolios--evidence of learning: an examination of students' perspectives

Portfolios in practice: Developing advancing practice within a musculoskeletal competency-based model

The role of E-portfolios in higher education: The experience of pre-service teachers

Assessment Tool of Portfolios: Enhancing Primary School Students' English Reading Proficiency

Key ePortfolio features and strategies for student success in a competency-based clinical research program

Implementing and evaluating an e-portfolio for postgraduate family medicine training in the Western Cape, South Africa

Special educational needs, e-learning and the reflective e-portfolio: implications for developing and assessing competence in pre-service education

A successful faculty development program for implementing a sociocultural ePortfolio assessment tool

E-PORTFOLIO AS A TOOL FOR PROFESSIONAL DEVELOPMENT AND ASSESSMENT OF THE PROSPECTIVE SINGERS

Portfolio assessment: Learning outcomes and students’ attitudes

"Teaching capital"- a sociological analysis of medical educator portfolios for promotion

Peer assessment of professional competence

A Portfolio Coach–Informed Professional Development Framework

Assessment Tools Preferred by the Undergraduate Clinical Medical Students: A Study in National Defense University of Malaysia

[Pedagogical reflective practice of nursing undergraduates: the portfolio as an instrument]

Exploring the Impact of Assessment on Medical Students’ Learning

A Novel Approach to Assessing Professionalism in Preclinical Medical Students Using Multisource Feedback Through Paired Self- and Peer Evaluations