Abstract:Sleep is an important indicator of a person's health, and its accurate and cost-effective quantification is of great value in healthcare. The gold standard for sleep assessment and the clinical diagnosis of sleep disorders is polysomnography (PSG). However, PSG requires an overnight clinic visit and trained technicians to score the obtained multimodality data. Wrist-worn consumer devices, such as smartwatches, are a promising alternative to PSG because of their small form factor, continuous monitoring capability, and popularity. Unlike PSG, however, wearables-derived data are noisier and far less information-rich because of the fewer number of modalities and less accurate measurements due to their small form factor. Given these challenges, most consumer devices perform two-stage (i.e., sleep-wake) classification, which is inadequate for deep insights into a person's sleep health. The challenging multi-class (three, four, or five-class) staging of sleep using data from wrist-worn wearables remains unresolved. The difference in the data quality between consumer-grade wearables and lab-grade clinical equipment is the motivation behind this study. In this paper, we present an artificial intelligence (AI) technique termed sequence-to-sequence LSTM for automated mobile sleep staging (SLAMSS), which can perform three-class (wake, NREM, REM) and four-class (wake, light, deep, REM) sleep classification from activity (i.e., wrist-accelerometry-derived locomotion) and two coarse heart rate measures—both of which can be reliably obtained from a consumer-grade wrist-wearable device. Our method relies on raw time-series datasets and obviates the need for manual feature selection. We validated our model using actigraphy and coarse heart rate data from two independent study populations: the Multi-Ethnic Study of Atherosclerosis (MESA; N = 808) cohort and the Osteoporotic Fractures in Men (MrOS; N = 817) cohort. SLAMSS achieves an overall accuracy of 79%, weighted F1 score of 0.80, 77% sensitivity, and 89% specificity for three-class sleep staging and an overall accuracy of 70-72%, weighted F1 score of 0.72-0.73, 64-66% sensitivity, and 89-90% specificity for four-class sleep staging in the MESA cohort. It yielded an overall accuracy of 77%, weighted F1 score of 0.77, 74% sensitivity, and 88% specificity for three-class sleep staging and an overall accuracy of 68-69%, weighted F1 score of 0.68-0.69, 60-63% sensitivity, and 88-89% specificity for four-class sleep staging in the MrOS cohort. These results were achieved with feature-poor inputs with a low temporal resolution. In addition, we extended our three-class staging model to an unrelated Apple Watch dataset. Importantly, SLAMSS predicts the duration of each sleep stage with high accuracy. This is especially significant for four-class sleep staging, where deep sleep is severely underrepresented. We show that, by appropriately choosing the loss function to address the inherent class imbalance, our method can accurately estimate deep sleep time (SLAMSS/MESA: 0.61±0.69 hours, PSG/MESA ground truth: 0.60±0.60 hours; SLAMSS/MrOS: 0.53±0.66 hours, PSG/MrOS ground truth: 0.55±0.57 hours;). Deep sleep quality and quantity are vital metrics and early indicators for a number of diseases. Our method, which enables accurate deep sleep estimation from wearables-derived data, is therefore promising for a variety of clinical applications requiring long-term deep sleep monitoring.

A Generic Algorithm for Sleep-Wake Cycle Detection using Unlabeled Actigraphy Data

Validating CircaCP: a generic sleep–wake cycle detection algorithm for unlabelled actigraphy data

Validating CircaCP: a Generic Sleep-Wake Cycle Detection Algorithm

A novel machine learning unsupervised algorithm for sleep/wake identification using actigraphy.

Automatic Classification of Sleep Stages Based on Raw Single-Channel EEG

A Hidden Markov Model Based Unsupervised Algorithm for Sleep/Wake Identification Using Actigraphy

Performance of an open machine learning model to classify sleep/wake from actigraphy across ∼24-hour intervals without knowledge of rest timing

0297 Comparing Validation Metrics of Machine Learning Algorithms for Actigraphy Data in Children

Circadian Rhythm Analysis Using Wearable Device Data: Novel Penalized Machine Learning Approach

Annotating sleep states in children from wrist-worn accelerometer data using Machine Learning

0275 Deep Learning-based Sleep Detection using Torso Patch Vital Signs Improves Sleep-Wake Detection over Wrist Actigraphy

Performance Evaluation of the Circadia Contactless Breathing Monitor and Sleep Analysis Algorithm for Sleep Stage Classification

Actigraphy-based Sleep/Wake Pattern Detection using Convolutional Neural Networks

40 years of actigraphy in sleep medicine and current state of the art algorithms

0280 Unlocking the Potential of Consumer Wearables for Predicting Sleep in Children: A Device-Agnostic Machine Learning Approach

1015 Evaluation of Actigraphy Sensors: Detecting Daytime Sleep After Stroke in an Inpatient Rehabilitation Hospital

Automatic Detection of Sleep Stages based on Accelerometer Signals from a Wristband

Estimation of Sleep Stages Analyzing Respiratory and Movement Signals

Validation of actigraphy sleep metrics in children aged 8 to 16 years: considerations for device type, placement and algorithms

AI-Driven sleep staging from actigraphy and heart rate

Characterizing Sleep Wake Circadian Rhythm Consolidation in Early Childhood and Its Association with Motor Development Using Actigraphy