Abstract:Standard instrument for the clinical diagnosis of sleep apnea is large and based on invasive method, which is not comfortable and not suitable for daily inspection. A video-based measurement method for the respiration rate (RR) is therefore proposed, which is meaningful to the home diagnosis of sleep apnea. We proposed a novel method for the visualization and calculation of RR from a video containing a sleeping person. The video was decomposed by spatio-temporal Laplacian pyramid method into multiresolution image sequences, which were filtered by an infinite-impulse-response bandpass filter to extract the respiration movement in the video. The respiration movement was amplified, and fused into the original video. On the other hand, the signal intensity of the filtering results was compared between layers of Laplacian pyramid to identify the layer with the strongest movement caused by respiration. A morphological calculation was conducted on the image reshaped from the filtered results in this layer, to find the region of interest (ROI) with most significant movement of respiration. The image intensity in the ROI was spatially averaged into a one-dimensional signal, of which the frequency domain was analyzed to obtain RR. The ROI and the calculation results for RR were visualized on the video with enhanced respiration movement. Ten videos lasting 30–60[Formula: see text]s were recorded by a general webcam. The respiration movement of the subject was successfully extracted and amplified, no matter the posture was supine or side lying. The thoracic and abdominal parts were generally identified as ROI in all postures. RR was calculated by the frequency domain analysis for the averaged image intensity in ROI with the error no more than 1 time per minute, and further, as well as ROI, was fused into the amplified video. The region of respiration movement and RR is calculated by the noncontact method, and well visualized in a video. The method provides a novel screening tool for the population suspected of sleep apnea, and is meaningful to the home diagnosis of sleep illness.

Non-contact breathing rate monitoring system using a magnification technique and convolutional networks

A non-contact oxygen saturation estimation using Video Magnification and a Deep Learning method

Revisiting Motion-Based Respiration Measurement from Videos

Motion-Robust Respiratory Rate Estimation From Camera Videos via Fusing Pixel Movement and Pixel Intensity Information

THE ESTIMATION OF RESPIRATION RATE BASED ON THE AMPLIFICATION OF RESPIRATION MOTION IN VIDEO

Non-Contact Respiration Measurement Method Based on RGB Camera Using 1D Convolutional Neural Networks

Multispectral Video Fusion for Non-Contact Monitoring of Respiratory Rate and Apnea

3D Convolutional Neural Networks for Remote Pulse Rate Measurement and Mapping from Facial Video

Robust CNN-based Respiration Rate Estimation for Smartwatch PPG and IMU

Automated Heartbeat Classification Using 3-D Inputs Based on Convolutional Neural Network with Multi-Fields of View.

Lightweight Video-Based Respiration Rate Detection Algorithm: an Application Case on Intensive Care

Non-Contact Monitoring of Breathing Pattern and Respiratory Rate via RGB Signal Measurement

Video-Based Respiratory Rate Estimation for Infants in the NICU

Non-contact measurement of human respiration using an infrared thermal camera and the deep learning method

[Research on non-contact respiratory rate measurement method based on video information].

A Real-Time Respiration Monitoring and Classification System Using a Depth Camera and Radars

ACTNet: Attention based CNN and Transformer network for respiratory rate estimation

Respiratory Rate Estimation from Thermal Video Data Using Spatio-Temporal Deep Learning

Machine learning‐based estimation of respiratory fluctuations in a healthy adult population using resting state BOLD fMRI and head motion parameters

A Feasibility Study of a Video-Based Heart Rate Estimation Method with Convolutional Neural Networks

Estimation of vital signs from facial videos via video magnification and deep learning