Abstract:Importance Selection processes for surgical training should aim to identify candidates who will become competent independent practitioners and should aspire to high standards of reliability and validity. Objective To determine the association between measured candidate factors at the time of an Irish selection and assessment outcomes in surgical training, examined via rate of progression to Higher Specialist Training (HST), attrition rates, and performance as assessed through a multimodal framework of workplace-based and simulation-based assessments. Design, Setting, and Participants This retrospective observational cohort study included data from all successful applicants to the Royal College of Surgeons in Ireland (RCSI) national Core Surgical Training (CST) program. Participants included all trainees recruited to dedicated postgraduate surgical training from 2016 to 2020. These data were analyzed from July 11, 2016, through July 10, 2022. Exposures Selection decisions were based on a composite score that was derived from technical aptitude assessments, undergraduate academic performance, and a 4-station multiple mini-interview. Main outcomes and measures Assessment data, attrition rates, and rates of progression to HST were recorded for each trainee. CST performance was assessed using workplace-based and simulation-based technical and nontechnical skill assessments. Potential associations between selection and assessment measures were explored using Pearson correlation, logistic regression, and multiple linear-regression analyses. Results Data were available for 303 trainees. Composite scores were positively associated with progression to HST (odds ratio [OR], 1.09; 95% CI, 1.05-1.13). There was a weak positive correlation, ranging from 0.23 to 0.34, between scores and performance across all CST assessments. Multivariable linear regression analysis showed technical aptitude scores at application were associated with future operative performance assessment scores, both in the workplace (β = 0.31; 95% CI, 0.14-0.48) and simulated environments (β = 0.57; 95% CI, 0.33-0.81). There was evidence that the interpersonal skills interview station was associated with future performance in simulated communication skill assessments (β = 0.55; 95% CI, 0.22-0.87). Conclusions and Relevance In this study, performance at the time of Irish national selection, measured across technical and nontechnical domains in a multimodal fashion, was associated with future performance in the workplace and in simulated environments. Future studies will be required to explore the consequential validity of selection, including potential unintended effects of selection and ranking on candidate performance.

Does training less-than-full-time predict performance at the FRCR exams?: a UKMED cohort study

Differential outcomes at the Fellowship of the Royal College of Radiologists (FRCR) exams according to demographic and socioeconomic factors

Less than full-time training, barriers and future needs. A UK-wide online survey of doctors in training

Differential attainment in higher surgical training: scoping pan-specialty spectra

Relationship between sociodemographic factors and selection into UK postgraduate medical training programmes: a national cohort study

Perceived causes of differential attainment in UK postgraduate medical training: a national qualitative study

Effect of sex on specialty training application outcomes: a longitudinal administrative data study of UK medical graduates

Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection

Fitness to practise sanctions in UK doctors are predicted by poor performance at MRCGP and MRCP(UK) assessments: data linkage study

DiffErential attainment and Factors AssoCiated with Training applications and Outcomes (DE FACTO) study: Trauma & Orthopaedic surgery in the UK

The Society of Radiologists in Training (SRT) 2024 Training Survey on the impact of recent changes to training and non-radiologist roles.

Differential attainment and recruitment to Intensive Care Medicine Training in the UK, 2018–2020

Egalitarianism in surgical training: let equity prevail

The hidden costs of the intercollegiate membership of the Royal College of surgeons examinations: Can trainees afford it?

Perspectives on Academic Training in Clinical Oncology in the United Kingdom: A National Cross-Sectional Analysis

Performance in Irish Selection and Future Performance in Surgical Training

Early Exposure and Its Impact on Cardiothoracic Surgery: an Experience of Medical Education in The United Kingdom

The impact of Longitudinal Integrated Foundation Training: preliminary experiences in the United Kingdom

'Maybe were not past the traditional gender roles then! Exploring less than full-time training among men in Scotland: a qualitative study

Paediatric radiology training in the UK: a national trainee survey by the British Society of Paediatric Radiologists (BSPR)

Exploring reasons for differences in performance between UK and international medical graduates in the Membership of the Royal College of General Practitioners Applied Knowledge Test: a cognitive interview study