Expert level of detection of interictal discharges with a deep neural network

Marleen C. Tjepkema‐Cloostermans,Martijn R. Tannemaat,Luuk Wieske,Anne‐Fleur van Rootselaar,Bas C. Stunnenberg,Hanneke M. Keijzer,Johannes H. T. M. Koelman,Selma C. Tromp,Ioana Dunca,Baukje J. van der Star,Myrthe E. de Koning,Michel J. A. M. van Putten
DOI: https://doi.org/10.1111/epi.18164
IF: 6.74
2024-11-16
Epilepsia
Abstract:Objective Deep learning methods have shown potential in automating the detection of interictal epileptiform discharges (IEDs) in electroencephalography (EEG). We compared IED detection using our previously trained deep neural network with a group of experts to assess its potential applicability. Methods First, we performed clinical validation on an internal data set. Seven experts reviewed all EEG studies. Performance agreement between experts and the network was compared at both the EEG and IED levels. All EEG recordings were also processed with Persyst. Subsequently, we performed external validation, with data from four centers, using a hybrid approach, where detections by the deep neural network were reviewed by an expert. In case of disagreement with the original report, the EEG recording was annotated independently by five experts. Results For internal validation we included 22 EEG studies with IEDs and 28 EEG studies from controls. At the EEG level, our network showed performance similar to that of the experts. For individual IED detection, the sensitivities between experts ranged from 20.7%–86.4%, whereas the sensitivity of our network was 82.5% (confidence interval [CI]: 77.7%–87.4%) at 99% specificity and a false detection rate (FDR) of
clinical neurology
What problem does this paper attempt to address?