ZleepAnlystNet: a novel deep learning model for automatic sleep stage scoring based on single-channel raw EEG data using separating training

Nantawachara Jirakittayakorn,Yodchanan Wongsawat,Somsak Mitrirattanakul
DOI: https://doi.org/10.1038/s41598-024-60796-y
IF: 4.6
2024-04-30
Scientific Reports
Abstract:Numerous models for sleep stage scoring utilizing single-channel raw EEG signal have typically employed CNN and BiLSTM architectures. While these models, incorporating temporal information for sequence classification, demonstrate superior overall performance, they often exhibit low per-class performance for N1-stage, necessitating an adjustment of loss function. However, the efficacy of such adjustment is constrained by the training process. In this study, a pioneering training approach called separating training is introduced, alongside a novel model, to enhance performance. The developed model comprises 15 CNN models with varying loss function weights for feature extraction and 1 BiLSTM for sequence classification. Due to its architecture, this model cannot be trained using an end-to-end approach, necessitating separate training for each component using the Sleep-EDF dataset. Achieving an overall accuracy of 87.02%, MF1 of 82.09%, Kappa of 0.8221, and per-class F1-socres (W 90.34%, N1 54.23%, N2 89.53%, N3 88.96%, and REM 87.40%), our model demonstrates promising performance. Comparison with sleep technicians reveals a Kappa of 0.7015, indicating alignment with reference sleep stags. Additionally, cross-dataset validation and adaptation through training with the SHHS dataset yield an overall accuracy of 84.40%, MF1 of 74.96% and Kappa of 0.7785 when tested with the Sleep-EDF-13 dataset. These findings underscore the generalization potential in model architecture design facilitated by our novel training approach.
multidisciplinary sciences
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is how to improve the performance of the automatic sleep - stage scoring model based on single - channel raw electroencephalogram (EEG) data, especially in view of the poor performance in N1 - stage classification. Specifically: 1. **Limitations of existing models**: - Currently, the models used for sleep - stage scoring usually adopt convolutional neural network (CNN) and bidirectional long - short - term memory network (BiLSTM) architectures. - Although these models perform well in overall performance, their classification accuracy in the N1 stage is low. - Adjusting the loss function to improve the performance in the N1 stage has a limited effect and is restricted by the training process. 2. **New methods introduced**: - This research proposes a new training method - separating training, and develops a new model named ZleepAnlystNet. - ZleepAnlystNet consists of 15 CNN models with different loss - function weights for feature extraction and a BiLSTM model for sequence classification. - Due to its architectural complexity, this model cannot be trained in an end - to - end manner, but needs to be trained for each component separately, using the Sleep - EDF dataset. 3. **Objectives and expected results**: - Improve the overall classification accuracy, especially the classification performance in the N1 stage. - Verify the effectiveness and consistency of the new model by comparing it with other models and human scorers. - Evaluate the generalization ability of the model on different datasets to ensure the feasibility of its clinical application. 4. **Specific improvement measures**: - **Separating training**: Through the separating training method, each component can focus more on specific tasks, thereby improving the overall performance. - **Data manipulation**: By experimenting with different combinations of input data, optimize the input features of the model and further improve the classification accuracy. Through these improvement measures, the research aims to develop a more efficient and accurate automatic sleep - stage scoring system to reduce the workload and error of manual scoring and improve the efficiency of clinical diagnosis.