Detection Method of Epileptic Seizures Using a Neural Network Model Based on Multimodal Dual-Stream Networks

Baiyang Wang,Yidong Xu,Siyu Peng,Hongjun Wang,Fang Li
DOI: https://doi.org/10.3390/s24113360
IF: 3.9
2024-05-24
Sensors
Abstract:Epilepsy is a common neurological disorder, and its diagnosis mainly relies on the analysis of electroencephalogram (EEG) signals. However, the raw EEG signals contain limited recognizable features, and in order to increase the recognizable features in the input of the network, the differential features of the signals, the amplitude spectrum and the phase spectrum in the frequency domain are extracted to form a two-dimensional feature vector. In order to solve the problem of recognizing multimodal features, a neural network model based on a multimodal dual-stream network is proposed, which uses a mixture of one-dimensional convolution, two-dimensional convolution and LSTM neural networks to extract the spatial features of the EEG two-dimensional vectors and the temporal features of the signals, respectively, and combines the advantages of the two networks, using the hybrid neural network to extract both the temporal and spatial features of the signals at the same time. In addition, a channel attention module was used to focus the model on features related to seizures. Finally, multiple sets of experiments were conducted on the Bonn and New Delhi data sets, and the highest accuracy rates of 99.69% and 97.5% were obtained on the test set, respectively, verifying the superiority of the proposed model in the task of epileptic seizure detection.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
### The Problem Addressed by the Paper This paper aims to address the issue of epilepsy seizure detection. Specifically: 1. **Feature Extraction**: - The paper proposes a neural network model based on multimodal dual-stream networks for processing electroencephalogram (EEG) signals. To enhance the identifiable features in the input network, differential features, amplitude spectrum, and phase spectrum are extracted from the raw EEG signals and combined into a 2D feature vector. 2. **Multimodal Feature Recognition**: - The model combines 1D convolution, 2D convolution, and long short-term memory (LSTM) neural networks to extract spatial and temporal features of EEG signals, respectively. By mixing neural networks, the model simultaneously extracts both temporal and spatial features of the signals. 3. **Attention Mechanism**: - A channel attention module is introduced, enabling the model to focus on features related to epilepsy seizures. 4. **Experimental Validation**: - Multiple experiments were conducted on the Bonn and New Delhi datasets, achieving a maximum accuracy of 99.69% and 97.5%, respectively, validating the superiority of the proposed model in the task of epilepsy seizure detection. Through these methods, the paper aims to improve the accuracy and efficiency of epilepsy seizure detection.