Abstract:Sleep staging is crucial for assessing sleep quality and diagnosing sleep disorders. Recent advances in deep learning methods with electroencephalogram (EEG) signals have shown remarkable success in automatic sleep staging. However, the use of deeper neural networks may lead to the issues of gradient disappearance and explosion, while the non-stationary nature and low signal-to-noise ratio of EEG signals can negatively impact feature representation. To overcome these challenges, we proposed a novel lightweight sequence-to-sequence deep learning model, 1D-ResNet-SE-LSTM, to classify sleep stages into five classes using single-channel raw EEG signals. Our proposed model consists of two main components: a one-dimensional residual convolutional neural network with a squeeze-and-excitation module to extract and reweight features from EEG signals, and a long short-term memory network to capture the transition rules among sleep stages. In addition, we applied the weighted cross-entropy loss function to alleviate the class imbalance problem. We evaluated the performance of our model on two publicly available datasets; Sleep-EDF Expanded consists of 153 overnight PSG recordings collected from 78 healthy subjects and ISRUC-Sleep includes 100 PSG recordings collected from 100 subjects diagnosed with various sleep disorders, and obtained an overall accuracy rate of 86.39% and 81.97%, respectively, along with corresponding macro average F1-scores of 81.95% and 79.94%. Our model outperforms existing sleep staging models in terms of overall performance metrics and per-class F1-scores for several sleep stages, particularly for the N1 stage, where it achieves F1-scores of 59.00% and 55.53%. The kappa coefficient is 0.812 and 0.766 for the Sleep-EDF Expanded and ISRUC-Sleep datasets, respectively, indicating strong agreement with certified sleep experts. We also investigated the effect of different weight coefficient combinations and sequence lengths of EEG epochs used as input to the model on its performance. Furthermore, the ablation study was conducted to evaluate the contribution of each component to the model's performance. The results demonstrate the effectiveness and robustness of the proposed model in classifying sleep stages, and highlights its potential to reduce human clinicians' workload, making sleep assessment and diagnosis more effective. However, the proposed model is subject to several limitations. Firstly, the model is a sequence-to-sequence network, which requires input sequences of EEG epochs. Secondly, the weight coefficients in the loss function could be further optimized to balance the classification performance of each sleep stage. Finally, apart from the channel attention mechanism, incorporating more advanced attention mechanisms could enhance the model's effectiveness.

0059 A Transformer Model for Predicting Cognitive Impairment from Sleep

Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks

0320 Foundational Transformers with Linear Probing for Sleep Stage Classification Using Time Series Sleep Study Data

CareSleepNet: A Hybrid Deep Learning Network for Automatic Sleep Staging

A Multi Constrained Transformer-BiLSTM Guided Network for Automated Sleep Stage Classification from Single-Channel EEG

A convolutional transformer for EEG sleep stage classification

A CNN-Transformer Deep Learning Model for Real-time Sleep Stage Classification in an Energy-Constrained Wireless Device

A foundational transformer leveraging full night, multichannel sleep study data accurately classifies sleep stages

Transformer-Based Contrastive Learning Method for Automated Sleep Stages Classification

Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder

A novel deep learning model based on transformer and cross modality attention for classification of sleep stages

Self-Supervised Transformer Model Training for a Sleep-EEG Foundation Model

Extracting Multi-Scale and Salient Features by MSE Based U-Structure and CBAM for Sleep Staging

Automatic sleep staging by a hybrid model based on deep 1D-ResNet-SE and LSTM with single-channel raw EEG signals

Sleep EEG-Based Approach to Detect Mild Cognitive Impairment

Laying the Foundation: Modern Transformers for Gold-Standard Sleep Analysis and Beyond

Automatic Sleep Scoring from Large-scale Multi-channel Pediatric EEG

Towards Interpretable Sleep Stage Classification Using Cross-Modal Transformers

A Transformer Approach for Cognitive Impairment Classification and Prediction

An attention-based deep learning approach for the classification of subjective cognitive decline and mild cognitive impairment using resting-state EEG

Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers