Abstract:Importance Selection processes for surgical training should aim to identify candidates who will become competent independent practitioners and should aspire to high standards of reliability and validity. Objective To determine the association between measured candidate factors at the time of an Irish selection and assessment outcomes in surgical training, examined via rate of progression to Higher Specialist Training (HST), attrition rates, and performance as assessed through a multimodal framework of workplace-based and simulation-based assessments. Design, Setting, and Participants This retrospective observational cohort study included data from all successful applicants to the Royal College of Surgeons in Ireland (RCSI) national Core Surgical Training (CST) program. Participants included all trainees recruited to dedicated postgraduate surgical training from 2016 to 2020. These data were analyzed from July 11, 2016, through July 10, 2022. Exposures Selection decisions were based on a composite score that was derived from technical aptitude assessments, undergraduate academic performance, and a 4-station multiple mini-interview. Main outcomes and measures Assessment data, attrition rates, and rates of progression to HST were recorded for each trainee. CST performance was assessed using workplace-based and simulation-based technical and nontechnical skill assessments. Potential associations between selection and assessment measures were explored using Pearson correlation, logistic regression, and multiple linear-regression analyses. Results Data were available for 303 trainees. Composite scores were positively associated with progression to HST (odds ratio [OR], 1.09; 95% CI, 1.05-1.13). There was a weak positive correlation, ranging from 0.23 to 0.34, between scores and performance across all CST assessments. Multivariable linear regression analysis showed technical aptitude scores at application were associated with future operative performance assessment scores, both in the workplace (β = 0.31; 95% CI, 0.14-0.48) and simulated environments (β = 0.57; 95% CI, 0.33-0.81). There was evidence that the interpersonal skills interview station was associated with future performance in simulated communication skill assessments (β = 0.55; 95% CI, 0.22-0.87). Conclusions and Relevance In this study, performance at the time of Irish national selection, measured across technical and nontechnical domains in a multimodal fashion, was associated with future performance in the workplace and in simulated environments. Future studies will be required to explore the consequential validity of selection, including potential unintended effects of selection and ranking on candidate performance.

Differential attainment and recruitment to Intensive Care Medicine Training in the UK, 2018–2020

Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection

Differential attainment in higher surgical training: scoping pan-specialty spectra

DiffErential attainment and Factors AssoCiated with Training applications and Outcomes (DE FACTO) study: Trauma & Orthopaedic surgery in the UK

Egalitarianism in surgical training: let equity prevail

Performance in Irish Selection and Future Performance in Surgical Training

Differential attainment: how can we close the gap in paediatrics?

Does training less-than-full-time predict performance at the FRCR exams?: a UKMED cohort study

Experience of Early Postgraduate Transition to Intensive Care Medicine: A Phenomenological Study

Experience of Differential Attainment in Psychiatry Trainees at Surrey and Borders Partnership NHS Foundation Trust (SABP)

Interhospital Variation in Admissions Managed With Critical Care Therapies or Invasive Hemodynamic Monitoring in Tertiary Cardiac Intensive Care Units: An Analysis From the Critical Care Cardiology Trials Network Registry

Perceived causes of differential attainment in UK postgraduate medical training: a national qualitative study

Differential attainment in assessment of postgraduate surgical trainees: a scoping review

Effect of sex on specialty training application outcomes: a longitudinal administrative data study of UK medical graduates

Early Exposure and Its Impact on Cardiothoracic Surgery: an Experience of Medical Education in The United Kingdom

Graduate entry medicine: selection criteria and student performance

Relationship between sociodemographic factors and selection into UK postgraduate medical training programmes: a national cohort study

Impact of Rank, Provider Specialty, and Unit Sustainment Training Frequency on Military Critical Care Air Transport Team Readiness

Protocol for the SELECT study: a sequential mixed methods study of the selection of UK medical students into clinical academic training

Preparing internal medicine trainees for their intensive care rotations: What are we doing across the UK?

Differential outcomes at the Fellowship of the Royal College of Radiologists (FRCR) exams according to demographic and socioeconomic factors