Learning and mortality in elderly psychiatric patients.

R. Sanderson,J. Inglis

DOI: https://doi.org/10.1093/GERONJ/16.4.375

1961-10-01

Journal of Gerontology

Abstract:

What problem does this paper attempt to address?

Towards Interpretable Sleep Stage Classification Using Cross-Modal Transformers

Jathurshan Pradeepkumar,Mithunjha Anandakumar,Vinith Kugathasan,Dhinesh Suntharalingham,Simon L. Kappel,Anjula C. De Silva,Chamira U. S. Edussooriya

2023-11-25

Abstract:Accurate sleep stage classification is significant for sleep health assessment. In recent years, several machine-learning based sleep staging algorithms have been developed , and in particular, deep-learning based algorithms have achieved performance on par with human annotation. Despite improved performance, a limitation of most deep-learning based algorithms is their black-box behavior, which have limited their use in clinical settings. Here, we propose a cross-modal transformer, which is a transformer-based method for sleep stage classification. The proposed cross-modal transformer consists of a novel cross-modal transformer encoder architecture along with a multi-scale one-dimensional convolutional neural network for automatic representation learning. Our method outperforms the state-of-the-art methods and eliminates the black-box behavior of deep-learning models by utilizing the interpretability aspect of the attention modules. Furthermore, our method provides considerable reductions in the number of parameters and training time compared to the state-of-the-art methods. Our code is available at <a class="link-external link-https" href="https://github.com/Jathurshan0330/Cross-Modal-Transformer" rel="external noopener nofollow">this https URL</a>. A demo of our work can be found at <a class="link-external link-https" href="https://bit.ly/Cross_modal_transformer_demo" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Signal Processing
Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers

Jathurshan Pradeepkumar,Mithunjha Anandakumar,Vinith Kugathasan,Dhinesh Suntharalingham,Simon L. Kappel,Anjula C. De Silva,Chamira U. S. Edussooriya

DOI: https://doi.org/10.1109/tnsre.2024.3438610

IF: 4.9

2024-08-18

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Accurate sleep stage classification is significant for sleep health assessment. In recent years, several machine-learning based sleep staging algorithms have been developed, and in particular, deep-learning based algorithms have achieved performance on par with human annotation. Despite improved performance, a limitation of most deep-learning based algorithms is their black-box behavior, which have limited their use in clinical settings. Here, we propose a cross-modal transformer, which is a transformer-based method for sleep stage classification. The proposed cross-modal transformer consists of a cross-modal transformer encoder architecture along with a multi-scale one-dimensional convolutional neural network for automatic representation learning. The performance of our method is on-par with the state-of-the-art methods and eliminates the black-box behavior of deep-learning models by utilizing the interpretability aspect of the attention modules. Furthermore, our method provides considerable reductions in the number of parameters and training time compared to the state-of-the-art methods. Our code is available at https://github.com/Jathurshan0330/Cross-Modal-Transformer. A demo of our work can be found at https://bit.ly/Cross_modal_transformer_demo.

engineering, biomedical,rehabilitation
CareSleepNet: A Hybrid Deep Learning Network for Automatic Sleep Staging

Jiquan Wang,Sha Zhao,Haiteng Jiang,Yangxuan Zhou,Zhenghe Yu,Tao Li,Shijian Li,Gang Pan

DOI: https://doi.org/10.1109/jbhi.2024.3426939

IF: 7.7

2024-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Sleep staging is essential for sleep assessment and plays an important role in disease diagnosis, which refers to the classification of sleep epochs into different sleep stages. Polysomnography (PSG), consisting of many different physiological signals, e.g. electroencephalogram (EEG) and electrooculogram (EOG), is a gold standard for sleep staging. Although existing studies have achieved high performance on automatic sleep staging from PSG, there are still some limitations: 1) they focus on local features but ignore global features within each sleep epoch, and 2) they ignore cross-modality context relationship between EEG and EOG. In this paper, we propose CareSleepNet, a novel hybrid deep learning network for automatic sleep staging from PSG recordings. Specifically, we first design a multi-scale Convolutional-Transformer Epoch Encoder to encode both local salient wave features and global features within each sleep epoch. Then, we devise a Cross-Modality Context Encoder based on co-attention mechanism to model cross-modality context relationship between different modalities. Next, we use a Transformer-based Sequence Encoder to capture the sequential relationship among sleep epochs. Finally, the learned feature representations are fed into an epoch-level classifier to determine the sleep stages. We collected a private sleep dataset, SSND, and use two public datasets, Sleep-EDF-153 and ISRUC to evaluate the performance of CareSleepNet. The experiment results show that our CareSleepNet achieves the state-of-the-art performance on the three datasets. Moreover, we conduct ablation studies and attention visualizations to prove the effectiveness of each module and to analyze the influence of each modality.
A CNN-Transformer-ConvLSTM-CRF Hybrid Network for Sleep Stage Classification

Weijie Zhang,Sheng Zhang,Yuanguo Wang,Chang Li,Hu Peng,Xun Chen

DOI: https://doi.org/10.1109/jsen.2024.3434404

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:Nowadays, many methods have emerged in the research direction of sleep stage classification. Nevertheless, previous researches have solely considered extracting the local features of EEG signals while overlooking the global features and the spatial relationship among these features. More importantly, they disregard the transformation relationship between sleep stages in adjacent epochs. To tackle the problems, we propose a CNN-Transformer-ConvLSTM-CRF hybrid model for sleep stage classification. It is made up of four crucial components: a local-global feature extraction module, a spatio-temporal encoder, an adaptive feature calibration module and a conditional random field (CRF) module. Specifically, multi-scale convolutional neural network (MSCNN) and Transformer make up the feature extraction module. MSCNN is capable of extracting EEG signals of different frequencies, and Transformer is used to obtain global features of EEG signals. Then, the spatio-temporal encoder which is composed of convolutional long short-term memory (ConvLSTM) can capture spatio-temporal relationship among EEG features. Subsequently, the adaptive feature calibration module consisting of a scSE block enables integrate information of channel features and spatial features. After that, our model outputs the initial classification results. Eventually, the CRF module is capable of learning the transition rules among sleep stages very well to enhance the accuracy of classification. We assess our model on three datasets and it outperforms state-of-the-art methods.
0320 Foundational Transformers with Linear Probing for Sleep Stage Classification Using Time Series Sleep Study Data

Benjamin Fox,Sajila Wickramaratne,Ankit Parekh,Girish Nadkarni

DOI: https://doi.org/10.1093/sleep/zsae067.0320

IF: 6.313

2024-04-20

SLEEP

Abstract:Abstract Introduction Sleep disorders and deprivation disrupt people's daily activities, mental health, and longevity and are related to widespread conditions. Currently, sleep disorders are diagnosed via polysomnography (PSG), where electrophysiological data is collected and manually annotated by a clinician. State of the art machine learning (ML) models, such as the transformer, are particularly well-suited for modeling timeseries PSG data. Specifically, self-supervised models with linear probing could assist with any relevant sleep predictive task including automating sleep stage classification, which would save clinicians time, reduce variability in manual scoring, and help scale to treat more people. Methods Using a self-supervised learning approach and the transformer architecture, we trained a self-supervised ML model that inputs seven PSG channels of length three hours including electroencephalogram, electrooculogram, electromyography, electrocardiography, oxygen saturation, and thoracic and abdomen respiratory rate using the Sleep Heart Health Study database (1995-1998). The model architecture uses the transformer’s attention mechanism to learn long range dependencies between intervals of sleep and a convolutional layer to learn relationships among channels. The model learns representations of PSG data through masked reconstruction with a mean squared error loss function. The representations are used as input into a deep neural network that is trained via linear probing (without adjusting the weights of the transformer model) to classify sleep stages. Results 5,794 sleep studies from the Sleep Heart Health Study with at least three hours of relevant PSG sleep channel and hypnogram data are included in training the self-supervised and linear probing models. Area under the receiver operator characters curve for sleep stage classification are 0.960 [0.960-0.961], 0.848 [0.846-0.849], 0.906 [0.906-0.907], 0.968 [0.967-0.968], and 0.931 [0.930-0.932] for wake, stage 1, stage 2, stage 3, and REM, respectively. Hyperparameter tuning, class weighting, and dataset cleaning will be performed to increase classification results. Conclusion A self-supervised training approach using the transformer architecture with linear probing was utilized to learn multichannel PSG data representations. These representations were used as input into a downstream model to classify sleep stages accurately. Future work should be done to examine the capabilities of the self-supervised model representations for other predictive sleep tasks. Support (if any) NIH K25HL151912, NIH R01HL171813, NIH R21HL165320

neurosciences,clinical neurology
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data

Kai Chieh Chang,Mark Hasegawa-Johnson,Nancy L. McElwain,Bashima Islam

2023-06-28

Abstract:Infant sleep is critical to brain and behavioral development. Prior studies on infant sleep/wake classification have been largely limited to reliance on expensive and burdensome polysomnography (PSG) tests in the laboratory or wearable devices that collect single-modality data. To facilitate data collection and accuracy of detection, we aimed to advance this field of study by using a multi-modal wearable device, LittleBeats (LB), to collect audio, electrocardiogram (ECG), and inertial measurement unit (IMU) data among a cohort of 28 infants. We employed a 3-branch (audio/ECG/IMU) large scale transformer-based neural network (NN) to demonstrate the potential of such multi-modal data. We pretrained each branch independently with its respective modality, then finetuned the model by fusing the pretrained transformer layers with cross-attention. We show that multi-modal data significantly improves sleep/wake classification (accuracy = 0.880), compared with use of a single modality (accuracy = 0.732). Our approach to multi-modal mid-level fusion may be adaptable to a diverse range of architectures and tasks, expanding future directions of infant behavioral research.

Multimedia,Sound,Audio and Speech Processing,Signal Processing
A convolutional transformer for EEG sleep stage classification

Zhuoran Li

DOI: https://doi.org/10.54254/2755-2721/74/20240451

2024-07-11

Abstract:Sleep is one of the most critical physiological processes in life, with profound implications for human health and functioning. Sleep stage classification is a fundamental task in sleep research, aiding in the understanding of the various stages of sleep and playing a crucial role in medical and health monitoring. Traditional Convolutional Neural Networks (CNNs) have limitations in handling long-range dependencies, focusing only on information within specific windows. For example, missing transitions between Rapid Eye Movement (REM) sleep stages and Non-Rapid Eye Movement (NREM) sleep stages. RNN may not effectively capture local features. For instance, RNNs might not effectively capture short awakenings or microarousals during sleep, which are crucial for accurate sleep stage classification. Subsequently, one limitation of transformers is their inefficiency in handling sequential data with long-range dependencies. To address these issues, we propose the Conformer model, which combines convolutional neural networks and transformers to efficiently capture both local and global dependencies in an electroencephalogram sequence. Conformer models employ various parameter reduction strategies, making the model more lightweight and suitable for embedded devices and low-resource environments. To validate our approach, we conducted comprehensive experiments using a widely collected single-channel EEG dataset and evaluated the model's performance. When compared to traditional methods and other deep learning approaches, our model demonstrates a significant advantage in capturing subtle features and patterns associated with different sleep stages.
A foundational transformer leveraging full night, multichannel sleep study data accurately classifies sleep stages

Benjamin Fox,Joy Jiang,Sajila Wickramaratne,Patricia Kovatch,Mayte Suarez-Farinas,Neomi A Shah,Ankit Parekh,Girish N Nadkarni

DOI: https://doi.org/10.1101/2024.08.02.24311417

2024-08-05

Abstract:Study Objectives. To investigate whether a foundational transformer model using 8-hour, multichannel data from polysomnograms can outperform existing artificial intelligence (AI) methods for sleep stage classification. Methods. We utilized the Sleep Heart Health Study (SHHS) visits 1 and 2 for training and validation and the Multi-Ethnic Study of Atherosclerosis (MESA) for testing of our model. We trained a self-supervised foundational transformer (called PFTSleep) that encodes 8-hour long sleep studies at 125 Hz with 7 signals including brain, movement, cardiac, oxygen, and respiratory channels. These encodings are used as input for training of an additional model to classify sleep stages, without adjusting the weights of the foundational transformer. We compared our results to existing AI methods that did not utilize 8-hour data or the full set of signals but did report evaluation metrics for the SHHS dataset. Results. We trained and validated a model with 8,444 sleep studies with 7 signals including brain, movement, cardiac, oxygen, and respiratory channels and tested on an additional 2,055 studies. In total, we trained and tested 587,944 hours of sleep study signal data. Area under the precision recall curve (AUPRC) scores were 0.82, 0.40, 0.53, 0.75, and 0.82 and area under the receiving operating characteristics curve (AUROC) scores were 0.99, 0.95, 0.96, 0.98, and 0.99 for wake, N1, N2, N3, and REM, respectively, on the SHHS validation set. For MESA, the AUPRC scores were 0.56, 0.16, 0.40, 0.45, and 0.65 and AUROC scores were 0.94, 0.77, 0.87, 0.91, and 0.96, respectively. Our model was compared to the longest context window state-of-the-art model and showed increases in macro evaluation scores, notably sensitivity (3.65% increase) and multi-class REM (3.39% increase) and wake (0.97% increase) F1 scores. Conclusions. Utilizing full night, multi-channel PSG data encodings derived from a foundational transformer improve sleep stage classification over existing methods.

Public and Global Health
Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder

Zhao Zhang,Bor-Shyh Lin,Chih-Wei Peng,Bor-Shing Lin

DOI: https://doi.org/10.1109/tnsre.2024.3394738

IF: 4.9

2024-06-11

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Sleep staging serves as a fundamental assessment for sleep quality measurement and sleep disorder diagnosis. Although current deep learning approaches have successfully integrated multimodal sleep signals, enhancing the accuracy of automatic sleep staging, certain challenges remain, as follows: 1) optimizing the utilization of multi-modal information complementarity, 2) effectively extracting both long- and short-range temporal features of sleep information, and 3) addressing the class imbalance problem in sleep data. To address these challenges, this paper proposes a two-stream encode-decoder network, named TSEDSleepNet, which is inspired by the depth sensitive attention and automatic multi-modal fusion (DSA2F) framework. In TSEDSleepNet, a two-stream encoder is used to extract the multiscale features of electrooculogram (EOG) and electroencephalogram (EEG) signals. And a self-attention mechanism is utilized to fuse the multiscale features, generating multi-modal saliency features. Subsequently, the coarser-scale construction module (CSCM) is adopted to extract and construct multi-resolution features from the multiscale features and the salient features. Thereafter, a Transformer module is applied to capture both long- and short-range temporal features from the multi-resolution features. Finally, the long- and short-range temporal features are restored with low-layer details and mapped to the predicted classification results. Additionally, the Lovász loss function is applied to alleviate the class imbalance problem in sleep datasets. Our proposed method was tested on the Sleep-EDF-39 and Sleep-EDF-153 datasets, and it achieved classification accuracies of 88.9% and 85.2% and Macro-F1 scores of 84.8% and 79.7%, respectively, thus outperforming conventional traditional baseline models. These results highlight the efficacy of the proposed method in fusing multi-modal information. This method has potential for application as an adjunct tool for diagnosing sleep disorders.

engineering, biomedical,rehabilitation
A Multi Constrained Transformer-BiLSTM Guided Network for Automated Sleep Stage Classification from Single-Channel EEG

Farhan Sadik,Md Tanvir Raihan,Rifat Bin Rashid,Minhjaur Rahman,Sabit Md Abdal,Shahed Ahmed,Talha Ibn Mahmud

2023-09-19

Abstract:Sleep stage classification from electroencephalogram (EEG) is significant for the rapid evaluation of sleeping patterns and quality. A novel deep learning architecture, ``DenseRTSleep-II'', is proposed for automatic sleep scoring from single-channel EEG signals. The architecture utilizes the advantages of Convolutional Neural Network (CNN), transformer network, and Bidirectional Long Short Term Memory (BiLSTM) for effective sleep scoring. Moreover, with the addition of a weighted multi-loss scheme, this model is trained more implicitly for vigorous decision-making tasks. Thus, the model generates the most efficient result in the SleepEDFx dataset and outperforms different state-of-the-art (IIT-Net, DeepSleepNet) techniques by a large margin in terms of accuracy, precision, and F1-score.

Signal Processing
A CNN-Transformer Deep Learning Model for Real-time Sleep Stage Classification in an Energy-Constrained Wireless Device

Yao,Z.,Liu,X.

DOI: https://doi.org/10.1101/2022.11.21.22282544

2022-11-23

MedRxiv

Abstract:This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy and memory-constrained devices for real-time operation with local processing. The Fpz-Cz EEG signals from a publicly available Sleep-EDF dataset are used to train and test the model. Four convolutional filter layers were used to extract features and reduce the data dimension. Then, transformers were utilized to learn the time-variant features of the data. To improve performance, we also implemented a subject specific training before the inference (i.e., prediction) stage. With the subject specific training, the F1 score was 0.91, 0.37, 0.84, 0.877, and 0.73 for wake, N1-N3, and rapid eye movement (REM) stages, respectively. The performance of the model was comparable to the state-of-the-art works with significantly greater computational costs. We tested a reduced-sized version of the proposed model on a low-cost Arduino Nano 33 BLE board and it was fully functional and accurate. In the future, a fully integrated wireless EEG sensor with edge DL will be developed for sleep research in pre-clinical and clinical experiments, such as real-time sleep modulation.
Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks

Mathieu Seraphim,Alexis Lechervy,Florian Yger,Luc Brun,Olivier Etard

2024-10-18

Abstract:Purpose: In sleep medicine, assessing the evolution of a subject's sleep often involves the costly manual scoring of electroencephalographic (EEG) signals. In recent years, a number of Deep Learning approaches have been proposed to automate this process, mainly by extracting features from said signals. However, despite some promising developments in related problems, such as Brain-Computer Interfaces, analyses of the covariances between brain regions remain underutilized in sleep stage <a class="link-external link-http" href="http://scoring.Methods" rel="external noopener nofollow">this http URL</a>: Expanding upon our previous work, we investigate the capabilities of SPDTransNet, a Transformer-derived network designed to classify sleep stages from EEG data through timeseries of covariance matrices. Furthermore, we present a novel way of integrating learned signal-wise features into said matrices without sacrificing their Symmetric Definite Positive (SPD) <a class="link-external link-http" href="http://nature.Results" rel="external noopener nofollow">this http URL</a>: Through comparison with other State-of-the-Art models within a methodology optimized for class-wise performance, we achieve a level of performance at or beyond various State-of-the-Art models, both in single-dataset and - particularly - multi-dataset <a class="link-external link-http" href="http://experiments.Conclusion" rel="external noopener nofollow">this http URL</a>: In this article, we prove the capabilities of our SPDTransNet model, particularly its adaptability to multi-dataset tasks, within the context of EEG sleep stage scoring - though it could easily be adapted to any classification task involving timeseries of covariance matrices.

Signal Processing,Machine Learning
Deep Neural Network method for Sleep Stages Classification using spectrogram of signal based on transfer learning with different domain data

Mohammad Mahdi Moradi,Mohammad Hosein Fatehi,Hassan Masoumi,Mehdi Taghizadeh

DOI: https://doi.org/10.24200/sci.2022.58204.5613

2022-07-15

Scientia Iranica

Abstract:Sleep stages Classification is a useful way to diagnose sleep problems. This is based on the processing of bio-signals (ECG, EEG, EOG, PPG). The less complex this signal is, the better the detection and processing. Feature extraction methods using hand are tedious and long lasting. Extraction of features without hand intervention are deep features, which are usually extracted from images. Analysis of time-frequency characteristics of non-static bio-signals is very important and has useful information. In this study, time-frequency image was extracted using ECG signal spectrogram and deep features were extracted using convolutional neural network. After extracting deep features, sleep stages were classified using deep transfer learning method. Network training was performed using one of the ECG signal and testing was performed with the other ECG signal channel.The results show that it is possible to detect sleep stages with acceptable accuracy with different amplitudes of signals. Sleep stages were detected with 98.92% accuracy and 96.52% sensitivity.

engineering, multidisciplinary
0059 A Transformer Model for Predicting Cognitive Impairment from Sleep

Tzu-An Song,Masoud Malekzadeh,Richa Saxena,Shaun M · Purcell,Joyita Dutta

DOI: https://doi.org/10.1093/sleep/zsae067.0059

IF: 6.313

2024-04-20

SLEEP

Abstract:Abstract Introduction Sleep disruptions have been found to have a strong association not only with normal cognitive decline that occurs with age, but also with dementia caused by neurodegenerative diseases such as Alzheimer's disease (AD). Predictive techniques that can automatically detect cognitive impairment from an individual’s sleep patterns have broad clinical and biological significance. We present an innovative multi-task learning paradigm that leverages deep learning to simultaneously predict cognitive performance measured from two distinct cognitive tests, Cognitive Abilities Screening Instrument (CASI) and Digit Symbol Coding Test (DSCT), using whole-night sleep electroencephalography (EEG) data, sleep stage labels, and covariates in an elderly cohort. Methods Our study utilizes data obtained from the Multi-Ethnic Study of Atherosclerosis (MESA) participants randomly assigned to two cohorts: validation (N=470) and training (N=1,110). Our approach uses a multi-task transformer architecture to learn complex patterns of sleep architecture for binary cognitive status prediction. The ground truth binary cognitive status labels (low and high score groups) are generated by using the dataset's median CASI and DSCT values as the thresholds. We use sleep EEG, sleep stage labels, and covariates as inputs and binary CASI and DSCT cognitive score classes as targets to train and validate our model. Results Our transformer model achieves an overall accuracy (OA) of 70.21% with an F1-score of 71.43% for CASI and 70.85% with an F1-score of 69.35% for DSCT. In comparison, a neural network trained using 132 handcrafted sleep features as inputs has an OA of 59.57% with an F1-score of 60.08% for CASI and 60.64% with an F1-score of 60.04% for DSCT. The OA and F1-score margins are 10.64% and 11.35% for CASI and 10.21% and 9.31% for DSCT, respectively. Conclusion We introduced a deep multi-task learning framework for predicting a person's cognitive status using whole-night sleep EEG data. Our transformer model outperforms the comparison method trained using the handcrafted features in OA and F1-score by a large margin. To our knowledge, this is the first deep learning model for jointly predicting cognitive status based on two different testing instruments from an individual’s sleep EEG data. Support (if any) This work was supported in part by the NIH grant 1R21AG068890-01.

neurosciences,clinical neurology
A Hybrid Self-Attention Deep Learning Framework for Multivariate Sleep Stage Classification

Ye Yuan,Kebin Jia,Fenglong Ma,Guangxu Xun,Yaqing Wang,Lu Su,Aidong Zhang

DOI: https://doi.org/10.1186/s12859-019-3075-z

IF: 3.307

2019-01-01

BMC Bioinformatics

Abstract:Background Sleep is a complex and dynamic biological process characterized by different sleep patterns. Comprehensive sleep monitoring and analysis using multivariate polysomnography (PSG) records has achieved significant efforts to prevent sleep-related disorders. To alleviate the time consumption caused by manual visual inspection of PSG, automatic multivariate sleep stage classification has become an important research topic in medical and bioinformatics. Results We present a unified hybrid self-attention deep learning framework, namely HybridAtt, to automatically classify sleep stages by capturing channel and temporal correlations from multivariate PSG records. We construct a new multi-view convolutional representation module to learn channel-specific and global view features from the heterogeneous PSG inputs. The hybrid attention mechanism is designed to further fuse the multi-view features by inferring their dependencies without any additional supervision. The learned attentional representation is subsequently fed through a softmax layer to train an end-to-end deep learning model. Conclusions We empirically evaluate our proposed HybridAtt model on a benchmark PSG dataset in two feature domains, referred to as the time and frequency domains. Experimental results show that HybridAtt consistently outperforms ten baseline methods in both feature spaces, demonstrating the effectiveness of HybridAtt in the task of sleep stage classification.
A Hybrid Deep Learning Scheme for Multi-Channel Sleep Stage Classification

Xiaorui Shao,Chang Soo Kim

DOI: https://doi.org/10.32604/cmc.2022.021830

2022-01-01

Abstract:Sleep stage classification plays a significant role in the accurate diagnosis and treatment of sleep-related diseases. This study aims to develop an efficient deep learning based scheme for correctly identifying sleep stages using multi-biological signals such as electroencephalography (EEG), electrocardiogram (ECG), electromyogram (EMG), and electrooculogram (EOG). Most of the prior studies in sleep stage classification focus on hand-crafted feature extraction methods. Traditional hand-crafted feature extraction methods choose features manually from raw data, which is tedious, and these features are limited in their ability to balance efficiency and accuracy. Moreover, most of the existing works on sleep staging are either single channel (a single-lead EEG may not contain enough information) or only EEG signal based which can not reveal more complicated physical features for reliable classification of various sleep stages. This study proposes an approach to combine Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRUs) that can discover hidden features from multi-biological signal data to recognize the different sleep stages efficiently. In the proposed scheme, the CNN is designed to extract concealed features from the multi-biological signals, and the GRU is employed to automatically learn the transition rules among different sleep stages. After that, the softmax layers are used to classify various sleep stages. The proposed method was tested on two publicly available databases: Sleep Heart Health Study (SHHS) and St. Vincent's University Hospital/University College Dublin Sleep Apnoea (UCDDB). The experimental results reveal that the proposed model yields better performance compared to state-of-the-art works. Our proposed scheme will assist in building a new system to deal with multi-channel or multi-modal signal processing tasks in various applications.
Laying the Foundation: Modern Transformers for Gold-Standard Sleep Analysis and Beyond

William G. Coon,Mattson Ogg

DOI: https://doi.org/10.1101/2024.01.18.576246

2024-05-01

Abstract:Accurate sleep assessment is critical to the practice of sleep medicine and sleep research. The recent availability of large quantities of publicly available sleep data, alongside recent breakthroughs in AI like transformer architectures, present novel opportunities for data-driven discovery efforts. Transformers are flexible neural networks that not only excel at classification tasks, but also can enable data-driven discovery through un-or self-supervised learning, which requires no human annotations to the input data. While transformers have been extensively used in supervised learning scenarios for sleep stage classification, they have not been fully explored or optimized in forms designed from the ground up for use in un-or self-supervised learning tasks in sleep. A necessary first step will be to study these models on a canonical benchmark supervised learning task (5-class sleep stage classification). Hence, to lay the groundwork for future data-driven discovery efforts, we evaluated optimizations of a transformer-based architecture that has already demonstrated substantial success in self-supervised learning in another domain (audio speech recognition), and trained it to perform the canonical 5-class sleep stage classification task, to establish foundational baselines in the sleep domain. We found that small transformer models designed from the start for (later) self-supervised learning can match other state-of-the-art automated sleep scoring techniques, while also providing the basis for future data-driven discovery efforts using large sleep data sets.

Neuroscience
Temporal convolutional networks and transformers for classifying the sleep stage in awake or asleep using pulse oximetry signals

Ramiro Casal,Leandro E. Di Persia,Gastón Schlotthauer

DOI: https://doi.org/10.48550/arXiv.2102.03352

2021-01-30

Abstract:Sleep disorders are very widespread in the world population and suffer from a generalized underdiagnosis, given the complexity of their diagnostic methods. Therefore, there is an increasing interest in developing simpler screening methods. A pulse oximeter is an ideal device for sleep disorder screenings since it is a portable, low-cost and accessible technology. This device can provide an estimation of the heart rate (HR), which can be useful to obtain information regarding the sleep stage. In this work, we developed a network architecture with the aim of classifying the sleep stage in awake or asleep using only HR signals from a pulse oximeter. The proposed architecture has two fundamental parts. The first part has the objective of obtaining a representation of the HR by using temporal convolutional networks. Then, the obtained representation is used to feed the second part, which is based on transformers, a model built solely with attention mechanisms. Transformers are able to model the sequence, learning the transition rules between sleep stages. The performance of the proposed method was evaluated on Sleep Heart Health Study dataset, composed of 5000 healthy and pathological subjects. The dataset was split into three subsets: 2500 for training, $1250$ for validating, and 1250 for testing. The overall accuracy, specificity, sensibility, and Cohen's Kappa coefficient were 90.0%, 94.9%, 78.1%, and 0.73.

Signal Processing,Machine Learning
A hybrid attention temporal sequential network for sleep stage classification

贾克斌,袁野,金峥

DOI: https://doi.org/10.7507/1001-5515.202008006

2021-01-01

Abstract:Sleep stage classification is a necessary fundamental method for the diagnosis of sleep diseases, which has attracted extensive attention in recent years. Traditional methods for sleep stage classification, such as manual marking methods and machine learning algorithms, have the limitations of low efficiency and defective generalization. Recently, deep neural networks have shown improved results by the capability of learning complex pattern in the sleep data. However, these models ignore the intra-temporal sequential information and the correlation among all channels in each segment of the sleep data. To solve these problems, a hybrid attention temporal sequential network model is proposed in this paper, choosing recurrent neural network to replace traditional convolutional neural network, and extracting temporal features of polysomnography from the perspective of time. Furthermore, intra-temporal attention mechanism and channel attention mechanism are adopted to achieve the fusion of the intra-temporal representation and the fusion of channel-correlated representation. And then, based on recurrent neural network and inter-temporal attention mechanism, this model further realized the fusion of inter-temporal contextual representation. Finally, the end-to-end automatic sleep stage classification is accomplished according to the above hybrid representation. This paper evaluates the proposed model based on two public benchmark sleep datasets downloaded from open-source website, which include a number of polysomnography. Experimental results show that the proposed model could achieve better performance compared with ten state-of-the-art baselines. The overall accuracy of sleep stage classification could reach 0.801, 0.801 and 0.717, respectively. Meanwhile, the macro average F1-scores of the proposed model could reach 0.752, 0.728 and 0.700. All experimental results could demonstrate the effectiveness of the proposed model.
Convolution- and Attention-Based Neural Network for Automated Sleep Stage Classification

Tianqi Zhu,Wei Luo,Feng Yu

DOI: https://doi.org/10.3390/ijerph17114152

IF: 4.614

2020-06-10

International Journal of Environmental Research and Public Health

Abstract:Analyzing polysomnography (PSG) is an effective method for evaluating sleep health; however, the sleep stage scoring required for PSG analysis is a time-consuming effort for an experienced medical expert. When scoring sleep epochs, experts pay attention to find specific signal characteristics (e.g., K-complexes and spindles), and sometimes need to integrate information from preceding and subsequent epochs in order to make a decision. To imitate this process and to build a more interpretable deep learning model, we propose a neural network based on a convolutional network (CNN) and attention mechanism to perform automatic sleep staging. The CNN learns local signal characteristics, and the attention mechanism excels in learning inter- and intra-epoch features. In experiments on the public sleep-edf and sleep-edfx databases with different training and testing set partitioning methods, our model achieved overall accuracies of 93.7% and 82.8%, and macro-average F1-scores of 84.5 and 77.8, respectively, outperforming recently reported machine learning-based methods.

public, environmental & occupational health,environmental sciences

Learning and mortality in elderly psychiatric patients.

Towards Interpretable Sleep Stage Classification Using Cross-Modal Transformers

Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers

CareSleepNet: A Hybrid Deep Learning Network for Automatic Sleep Staging

A CNN-Transformer-ConvLSTM-CRF Hybrid Network for Sleep Stage Classification

0320 Foundational Transformers with Linear Probing for Sleep Stage Classification Using Time Series Sleep Study Data

Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data

A convolutional transformer for EEG sleep stage classification

A foundational transformer leveraging full night, multichannel sleep study data accurately classifies sleep stages

Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder

A Multi Constrained Transformer-BiLSTM Guided Network for Automated Sleep Stage Classification from Single-Channel EEG

A CNN-Transformer Deep Learning Model for Real-time Sleep Stage Classification in an Energy-Constrained Wireless Device

Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks

Deep Neural Network method for Sleep Stages Classification using spectrogram of signal based on transfer learning with different domain data

0059 A Transformer Model for Predicting Cognitive Impairment from Sleep

A Hybrid Self-Attention Deep Learning Framework for Multivariate Sleep Stage Classification

A Hybrid Deep Learning Scheme for Multi-Channel Sleep Stage Classification

Laying the Foundation: Modern Transformers for Gold-Standard Sleep Analysis and Beyond

Temporal convolutional networks and transformers for classifying the sleep stage in awake or asleep using pulse oximetry signals

A hybrid attention temporal sequential network for sleep stage classification

Convolution- and Attention-Based Neural Network for Automated Sleep Stage Classification