Adapting Action Recognition Neural Networks for Automated Infantile Spasm Detection
Samuel Diop,Nouha Essid,François Jouen,Jean Bergounioux,Imen Trabelsi
DOI: https://doi.org/10.1109/tnsre.2024.3472088
IF: 4.9
2024-10-11
IEEE Transactions on Neural Systems and Rehabilitation Engineering
Abstract:Infantile spasms are a severe epileptic syndrome characterized by short muscular contractions lasting from 0.5 to 2 seconds. They are often misdiagnosed due to their atypical presentation, and treatment is frequently delayed, leading to stagnation or regression in psychomotor development and significant cognitive and motor sequelae. One promising approach to addressing this issue is the use of markerless computer vision techniques. In this paper, we introduce a novel approach for recognizing infantile spasms based exclusively on video data. We utilize an expanded 3D neural network pre-trained on an extensive human action recognition dataset called Kinetics. By employing this model, we extract features from short segments of varying sizes sampled from seizure videos, which allows us to effectively capture the spatio-temporal characteristics of infantile spasms. We then apply multiple classifiers to perform binary classification on these extracted features. The best system achieved an average area under the ROC curve of for a 3-second window.
engineering, biomedical,rehabilitation
What problem does this paper attempt to address?