Education Research: Competency-Based EEG Education: An Online Routine EEG Examination for Adult and Child Neurology Residents
Fábio A Nascimento,Hong Gao,Roohi Katyal,Rebecca Matthews,Samantha V Yap,Stefan Rampp,William O Tatum,Roy E Strowd 3rd,Sándor Beniczky
DOI: https://doi.org/10.1212/NE9.0000000000200094
2023-10-16
Abstract:Background and objectives: We recently published expert consensus-based curricular objectives for routine EEG (rEEG) interpretation for adult and child neurology residents. In this study, we used this curriculum framework to develop and validate an online, competency-based, formative and summative rEEG examination for neurology residents. Methods: We developed an online rEEG examination consisting of a brief survey and 30 multiple-choice questions covering EEG learning objectives for neurology residents in 4 domains: normal, abnormal, normal variants, and artifacts. Each question contained a deidentified EEG image, displayed in 2 montages (bipolar and average), reviewed and optimized by the authors to address the learning objectives. Respondents reported their level of confidence (LOC, 5-point Likert scale) with identifying 4 categories of EEG findings independently: states of wakefulness/sleep, sleep structures, normal variants, and artifacts. Accuracy and item discrimination were calculated for each question and LOC for each category. The test was disseminated by the International League Against Epilepsy and shared on social media. Results: Of 2,080 responses, 922 were complete. Respondents comprised clinical neurophysiologists/experts (n = 41), EEG/epilepsy clinical fellows (n = 211), EEG technologists (n = 128), attending neurologists (n = 111), adult neurology residents (n = 227), child neurology residents (n = 108), medical students (n = 24), attending non-neurologists (n = 18), and others (n = 54). Mean overall scores (95% CI) were 82% (77-86) (clinical neurophysiologists), 81% (79-83) (clinical fellows), and 72% (70-73) (adult and child neurology residents). Experts were more confident than clinical fellows in all categories but sleep structures. Experts and clinical fellows were more confident than residents in all 4 categories. Among residents, accuracy and LOC increased as a function of prior EEG weeks of training. Accuracy improved from 67% (baseline/no prior EEG training) to 77% (>12 prior EEG weeks). More than 8 weeks of EEG training was needed to reach accuracy comparable with clinical neurophysiologists on this rEEG examination. Increase in LOC was slower and less robust than increase in accuracy. All but 3 questions had a high discrimination index (>0.25). Discussion: This online, competency-based rEEG examination, mapped to a published EEG curriculum, has excellent psychometrics and differentiates experienced EEG readers from adult and child neurology residents. This online tool has the potential to improve resident EEG education worldwide.