Proof of principle study: diagnostic accuracy of a novel algorithm for the estimation of sleep stages and disease severity in patients with sleep-disordered breathing based on actigraphy and respiratory inductance plethysmography

Sarah Dietz-Terjung,Amelie Ricarda Martin,Eysteinn Finnsson,Jón Skínir Ágústsson,Snorri Helgason,Halla Helgadóttir,Matthias Welsner,Christian Taube,Gerhard Weinreich,Christoph Schöbel
DOI: https://doi.org/10.1007/s11325-021-02316-0
2021-02-16
Sleep And Breathing
Abstract:Abstract Purpose In this proof of principle study, we evaluated the diagnostic accuracy of the novel Nox BodySleep TM 1.0 algorithm (Nox Medical, Iceland) for the estimation of disease severity and sleep stages based on features extracted from actigraphy and respiratory inductance plethysmography (RIP) belts. Validation was performed against in-lab polysomnography (PSG) in patients with sleep-disordered breathing (SDB). Methods Patients received PSG according to AASM. Sleep stages were manually scored using the AASM criteria and the recording was evaluated by the novel algorithm. The results were analyzed by descriptive statistics methods (IBM SPSS Statistics 25.0). Results We found a strong Pearson correlation ( r =0.91) with a bias of 0.2/h for AHI estimation as well as a good correlation ( r =0.81) and an overestimation of 14 min for total sleep time (TST). Sleep efficiency (SE) was also valued with a good Pearson correlation ( r =0.73) and an overestimation of 2.1%. Wake epochs were estimated with a sensitivity of 0.65 and a specificity of 0.59 while REM and non-REM (NREM) phases were evaluated a sensitivity of 0.72 and 0.74, respectively. Specificity was 0.74 for NREM and 0.68 for REM. Additionally, a Cohen’s kappa of 0.62 was found for this 3-class classification problem. Conclusion The algorithm shows a moderate diagnostic accuracy for the estimation of sleep. In addition, the algorithm determines the AHI with good agreement with the manual scoring and it shows good diagnostic accuracy in estimating wake-sleep transition. The presented algorithm seems to be an appropriate tool to increase the diagnostic accuracy of portable monitoring. The validated diagnostic algorithm promises a more appropriate and cost-effective method if integrated in out-of-center (OOC) testing of patients with suspicion for SDB.
clinical neurology,respiratory system
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the diagnostic accuracy of a new algorithm (Nox BodySleepTM1.0) in estimating sleep stages and disease severity based on actigraphy and respiratory inductance plethysmography (RIP) belts. Specifically, this study aims to verify whether this algorithm can accurately assess the sleep staging and disease severity of patients with sleep - disordered breathing (SDB) and compare it with laboratory polysomnography (PSG). ### Research Background and Problem Sleep - disordered breathing (SDB) has a relatively high incidence in the general population, and long - term untreated SDB is closely related to health risks such as cardiovascular diseases. Currently, the diagnosis of SDB mainly depends on laboratory polysomnography (PSG), but this method is time - consuming, labor - intensive and costly. Therefore, it is particularly important to develop a technology that can accurately diagnose SDB in a home environment. ### Research Objectives The main objectives of this study are to evaluate the performance of the Nox BodySleepTM1.0 algorithm in the following aspects: 1. **Sleep Staging**: Distinguish between wakefulness, rapid eye movement (REM) sleep and non - rapid eye movement (NREM) sleep. 2. **Disease Severity**: In particular, assess the severity of SDB by estimating the apnea - hypopnea index (AHI), total sleep time (TST) and sleep efficiency (SE). ### Methods The researchers used PSG data from 128 suspected SDB patients. These data include electroencephalogram (EEG), electrooculogram (EOG), electromyogram (EMG), thoraco - abdominal respiratory movement, blood oxygen saturation, etc. The Nox BodySleepTM1.0 algorithm extracts features based on actigraphy and RIP signals and classifies 30 - second sleep segments through an artificial neural network (ANN). This algorithm uses a recurrent neural network (RNN) with three fully - connected layers and one recurrent layer, and finally selects the most likely sleep state through the SoftMax function. ### Results The research results show that: - **AHI Estimation**: There is a strong correlation between the algorithm and the manually - scored AHI (Pearson correlation coefficient \(r = 0.91\)), with a deviation of 0.2 events per hour. - **Total Sleep Time (TST)**: There is a relatively good correlation between the algorithm and the manually - scored TST (\(r = 0.81\)), but it generally overestimates by 14 minutes. - **Sleep Efficiency (SE)**: There is also a relatively good correlation between the algorithm and the manually - scored SE (\(r = 0.73\)), but it overestimates by 2.1%. - **Sleep Staging**: The sensitivities and specificities for wakefulness, REM and NREM sleep are 65%/59%, 72%/68% and 74%/70% respectively, and the Cohen’s kappa value is 0.62, indicating substantial agreement. ### Conclusions The Nox BodySleepTM1.0 algorithm shows moderate to good diagnostic accuracy in estimating sleep staging and SDB severity. This algorithm can better estimate AHI and has high accuracy in determining wake - sleep transitions. This makes it an effective tool for improving the diagnostic accuracy of portable monitoring devices, especially in out - of - center (OOC) testing, and is expected to provide a more efficient and economical diagnostic method. ### Potential Impacts If this algorithm is integrated into portable monitoring devices, SDB can be diagnosed more conveniently and accurately without relying on complex devices, thereby improving diagnostic efficiency and reducing costs.