Abstract:Sleep staging serves as a fundamental assessment for sleep quality measurement and sleep disorder diagnosis. Although current deep learning approaches have successfully integrated multimodal sleep signals, enhancing the accuracy of automatic sleep staging, certain challenges remain, as follows: 1) optimizing the utilization of multi-modal information complementarity, 2) effectively extracting both long- and short-range temporal features of sleep information, and 3) addressing the class imbalance problem in sleep data. To address these challenges, this paper proposes a two-stream encode-decoder network, named TSEDSleepNet, which is inspired by the depth sensitive attention and automatic multi-modal fusion (DSA2F) framework. In TSEDSleepNet, a two-stream encoder is used to extract the multiscale features of electrooculogram (EOG) and electroencephalogram (EEG) signals. And a self-attention mechanism is utilized to fuse the multiscale features, generating multi-modal saliency features. Subsequently, the coarser-scale construction module (CSCM) is adopted to extract and construct multi-resolution features from the multiscale features and the salient features. Thereafter, a Transformer module is applied to capture both long- and short-range temporal features from the multi-resolution features. Finally, the long- and short-range temporal features are restored with low-layer details and mapped to the predicted classification results. Additionally, the Lovász loss function is applied to alleviate the class imbalance problem in sleep datasets. Our proposed method was tested on the Sleep-EDF-39 and Sleep-EDF-153 datasets, and it achieved classification accuracies of 88.9% and 85.2% and Macro-F1 scores of 84.8% and 79.7%, respectively, thus outperforming conventional traditional baseline models. These results highlight the efficacy of the proposed method in fusing multi-modal information. This method has potential for application as an adjunct tool for diagnosing sleep disorders.

Self-Supervised Learning for Sleep Stage Classification with Temporal Augmentation and False Negative Suppression.

Automatic Classification of Sleep Stages Based on Raw Single-Channel EEG

Sleep Stage Classification Via Multi-View Based Self-Supervised Contrastive Learning of EEG

Antiviral effect of TNF-alpha and IFN-gamma secreted from a CD8+ influenza virus-specific CTL clone.

CareSleepNet: A Hybrid Deep Learning Network for Automatic Sleep Staging

Self-supervised Contrastive Learning for EEG-based Sleep Staging

[Study of protein structure by laser Raman spectroscopy (author's transl)].

Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder

A novel feature relearning method for automatic sleep staging based on single-channel EEG

A novel dual-stream time-frequency contrastive pretext tasks framework for sleep stage classification

SHNN: A single-channel EEG sleep staging model based on semi-supervised learning

Multi-Modal Physiological Signals Based Squeeze-and-Excitation Network With Domain Adversarial Learning for Sleep Staging

Self-supervised EEG Representation Learning for Automatic Sleep Staging

A Feature Fusion Model Based on Temporal Convolutional Network for Automatic Sleep Staging Using Single-Channel EEG

Unsupervised Assisted Sleep Staging Classification Algorithm under Fuzzy Few Samples

Amplitude–Time Dual-View Fused EEG Temporal Feature Learning for Automatic Sleep Staging

Automatic sleep staging of single-channel EEG based on domain adversarial neural networks and domain self-attention

Improved Model Accuracy Based on a Simple Frame of Temporal-Correlation Representation Method in Sleep Staging

A Two-Stage Neural Network for Sleep Stage Classification Based on Feature Learning, Sequence Learning, and Data Augmentation

Explore intrinsic geometry of sleep dynamics and predict sleep stage by unsupervised learning techniques

Single-channel EEG sleep staging based on data augmentation and cross-subject discrepancy alleviation