Abstract:Remote noncontact respiratory rate estimation by facial visual information has great research significance, providing valuable priors for health monitoring, clinical diagnosis, and anti-fraud. However, existing studies suffer from disturbances in epidermal specular reflections induced by head movements and facial expressions. Furthermore, diffuse reflections of light in the skin-colored subcutaneous tissue caused by multiple time-varying physiological signals independent of breathing are entangled with the intention of the respiratory process, leading to confusion in current research. To address these issues, this article proposes a novel network for natural light video-based remote respiration estimation. Specifically, our model consists of a two-stage architecture that progressively implements vital measurements. The first stage adopts an encoder-decoder structure to recharacterize the facial motion frame differences of the input video based on the gradient binary state of the respiratory signal during inspiration and expiration. Then, the obtained generative mapping, which is disentangled from various time-varying interferences and is only linearly related to the respiratory state, is combined with the facial appearance in the second stage. To further improve the robustness of our algorithm, we design a targeted long-term temporal attention module and embed it between the two stages to enhance the network's ability to model the breathing cycle that occupies ultra many frames and to mine hidden timing change clues. We train and validate the proposed network on a series of publicly available respiration estimation datasets, and the experimental results demonstrate its competitiveness against the state-of-the-art breathing and physiological prediction frameworks.

Collaborative use of RGB and thermal imaging for remote breathing rate measurement under realistic conditions

RGB-thermal Imaging System Collaborated with Marker Tracking for Remote Breathing Rate Measurement.

Synergetic Use of Thermal and Visible Imaging Techniques for Contactless and Unobtrusive Breathing Measurement

Real-time detection of respiration rate with non-contact mode based on low-end imaging equipment

An Unobtrusive and Non-Contact Method for Respiratory Measurement with Respiratory Region Detecting Algorithm Based on Depth Images.

A Real-Time Respiration Monitoring and Classification System Using a Depth Camera and Radars

Combination of Near-Infrared and Thermal Imaging Techniques for the Remote and Simultaneous Measurements of Breathing and Heart Rates under Sleep Situation.

Real-time Contactless Monitoring of Respiration Rate and Heart Rate Based on Thermal Imaging Technology

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Influence of Image Resolution on the Performance of Remote Breathing Rate Measurement Using Thermal Imaging Technique

Respiratory Consultant by Your Side: Affordable and Remote Intelligent Respiratory Rate and Respiratory Pattern Monitoring System

Unobtrusive Respiratory Monitoring System for Intensive Care

TR-BREATH: Time-Reversal Breathing Rate Estimation and Detection.

Low-Cost and Unobtrusive Respiratory Condition Monitoring Based on Raspberry Pi and Recurrent Neural Network.

[Research on non-contact respiratory rate measurement method based on video information].

How Do You Breathe-a Non-Contact Monitoring Method Using Depth Data

Non-Contact Monitoring of Breathing Pattern and Respiratory Rate via RGB Signal Measurement

Thermal Image Processing for Respiratory Estimation from Cubical Data with Expandable Depth

Lightweight Video-Based Respiration Rate Detection Algorithm: an Application Case on Intensive Care

Non-Contact Respiratory Monitoring Using an RGB Camera for Real-World Applications

Video-Based Multiphysiological Disentanglement and Remote Robust Estimation for Respiration