Abstract:Surgery for spinal disorders represents some of the commonest surgical procedures performed in many countries worldwide, carried out by neurosurgeons and orthopedic surgeons. Residency training is shifting to competency-based medical education, which requires setting standards for graduating residents and their assessments. However, gaps exist in the literature regarding the parameters used for assessment and the mastery levels expected of graduating residents in the performance of common spinal procedures as defined in Entrustable Professional Activities (EPAs). The objectives of the study were to describe the assessment parameters used for residents, identify the standard of performance expected of graduating residents of EPAs of spinal procedures, and identify factors predicting the expected standard of competent performance of graduating residents. The survey was sent to neurosurgery and orthopedic surgery Faculty requesting their recommendations on parameters of assessment and the expected standard competence performance for EPAs related to spinal procedures using our entrustment scale (A-E). Based on total responses, the recommended number of assessments and assessors for each EPA was 5 and 2, respectively. Regarding each specialty, there was no significant difference in the recommended number of assessments for each EPA. However, neurosurgery Faculty recommended higher number of assessors(n = 3) than orthopedic surgery Faculty(n = 2) for both posterior spinal decompression EPA(PSD) (p = 0.01) and spinal instrumentation EPA(SI) (p = 0.04). Based on total responses, 83% felt PSD was appropriate to the general practice, 86.8% considered it not too broad, and 62.3% expected entrustment level E as a graduation target. The proportions of these ratings were slightly lower for SI at 58.5%, 71.7% and 56.6%, respectively. Both specialties indicated that the EPAs were not too broad. In contrast, neurosurgery Faculty were more likely to consider these EPAs appropriate for general practice than orthopedic surgery Faculty for both PSD (94.7% vs 53.3%, p = 0.0003) and SI (68.4% vs 33.3%, p = 0.02). Moreover, neurosurgery Faculty had a higher expected standard of performance as a graduation target for both PSD (Level E 76.3% vs 26.7%, p = 0.001) and SI (Level E 65.8% vs 33.3%, p = 0.03) than orthopedic surgery Faculty. Expectations of entrustment level E for PSD was associated with the belief that the current EPA was appropriate for the general practice of their specialty with an odds ratio of 8.35 (p = 0.01, 95%CI 1.53–45.67). A difference exists in parameters of assessment and expected standard competence performance of spine procedures among spinal surgery specialties. In our opinion, there should be efforts to develop consensus between specialties for the sake of uniform delivery of high-quality care for patients regardless of the specialty of their surgeon. Our results will be particularly valuable to certification bodies in the assessment of spinal milestones. This study has important implications for the design of residency and fellowship education in spinal surgery internationally.

A Question of Scale? Generalizability of the Ottawa and Chen Scales to Render Entrustment Decisions for the Core EPAs in the Workplace

Workplace-Based Entrustment Scales for the Core EPAs: A Multisite Comparison of Validity Evidence for Two Proposed Instruments Using Structured Vignettes and Trained Raters

How well do workplace-based assessments support summative entrustment decisions? A multi-institutional generalisability study

Framing our Expectations: Variability in Entrustable Professional Activity Assessments

Domains Influencing Faculty Decisions on the Level of Supervision Required for Anesthesiology EPAs with Analysis of Feedback Comments

"A whole other competence story": exploring faculty perspectives on the process of workplace-based assessment of entrustable professional activities

Trainee anaesthetist self-assessment using an entrustment scale in workplace-based assessment

Validity Evidence for Assessing Entrustable Professional Activities During Undergraduate Medical Education

An Analysis of Workplace-Based Assessments for Core Entrustable Professional Activities for Entering Residency: Does Type of Clinical Assessor Influence Level of Supervision Ratings?

WBAs in UME—How Many Are Needed? A Reliability Analysis of 5 AAMC Core EPAs Implemented in the Internal Medicine Clerkship

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs

Educating residents in spine surgery: A study of Entrustable professional activities in neurosurgery and orthopedic surgery

Introducing an assessment tool based on a full set of end-of-training EPAs to capture the workplace performance of final-year medical students

Entrustment decisions: Implications for curriculum development and assessment

Exploring assessor cognition as a source of score variability in a performance assessment of practice-based competencies

Exploration of validity evidence for core residency entrustable professional activities in Chinese pediatric residency

Core EPAs in the Acting Internship: Early Outcomes from an Interdepartmental Experience

Finding a Path to Entrustment in Undergraduate Medical Education: A Progress Report From the AAMC Core Entrustable Professional Activities for Entering Residency Entrustment Concept Group

Assessment Scale of Professionalism in Surgery Residents Receiving Standardized Training：Design and Preliminary Evaluation on the Reliability and Validity

Twelve tips for the implementation of EPAs for assessment and entrustment decisions

Clinical competency committee perceptions of entrustable professional activities and their value in assessing fellows: A qualitative study of pediatric subspecialty program directors