Deep Learning-Enabled Sleep Staging From Vital Signs and Activity Measured Using a Near-Infrared Video Camera

Jonathan Carter,João Jorge,Bindia Venugopal,Oliver Gibson,Lionel Tarassenko
2023-06-06
Abstract:Conventional sleep monitoring is time-consuming, expensive and uncomfortable, requiring a large number of contact sensors to be attached to the patient. Video data is commonly recorded as part of a sleep laboratory assessment. If accurate sleep staging could be achieved solely from video, this would overcome many of the problems of traditional methods. In this work we use heart rate, breathing rate and activity measures, all derived from a near-infrared video camera, to perform sleep stage classification. We use a deep transfer learning approach to overcome data scarcity, by using an existing contact-sensor dataset to learn effective representations from the heart and breathing rate time series. Using a dataset of 50 healthy volunteers, we achieve an accuracy of 73.4\% and a Cohen's kappa of 0.61 in four-class sleep stage classification, establishing a new state-of-the-art for video-based sleep staging.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the issues present in traditional sleep monitoring methods, which include being time-consuming, expensive, and uncomfortable for patients. Specifically, traditional polysomnography (vPSG) requires connecting numerous contact sensors to the patient, which not only makes the patient uncomfortable but may also lead to unrepresentative sleep data. Additionally, the data analysis after monitoring requires manual annotation by experts, making the process cumbersome and time-consuming. The paper proposes a method for sleep staging based on heart rate, respiratory rate, and activity information obtained from a near-infrared video camera. It overcomes the problem of data scarcity through deep transfer learning techniques and uses existing contact sensor datasets to learn effective representations of heart rate and respiratory rate time series. Experimental results show that this method achieved an accuracy of 73.4% and a Cohen’s kappa value of 0.61 on a dataset containing 50 healthy volunteers, reaching the current best level in four-class sleep staging. This method completely eliminates the need for patient contact, simplifying the monitoring process for patients while also enhancing the convenience of clinical research. It is beneficial for long-term monitoring and research on sleep disorder treatments.