Abstract:Respiratory rate (RR) monitoring is essential in neonatal intensive care units. Despite its importance, RR is still monitored intermittently by manual counting instead of continuous monitoring due to the risk of skin damage with prolonged use of contact electrodes in preterm neonates and false signals due to displacement of electrodes. Thermal imaging has recently gained significance as a non-contact method for RR detection because of its many advantages. However, due to the lack of information in thermal images, the selection and tracking of the region of interest (ROI) in thermal images for neonates are challenging. This paper presents the integration of visible (RGB) and thermal (T) image sequences for the selection and tracking of ROI for breathing rate extraction. The deep-learning based tracking-by-detection approach is employed to detect the ROI in the RGB images, and it is mapped to the thermal images using the RGB-T image registration. The mapped ROI in thermal spectrum sequences gives the respiratory rate. The study was conducted first on healthy adults in different modes, including steady, motion, talking, and variable respiratory order. Subsequently, the method is tested on neonates in a clinical settings. The findings have been validated with a contact-based reference method.The average absolute error between the proposed and belt-based contact method in healthy adults reached 0.1 bpm and for more challenging conditions was approximately 1.5 bpm and 1.8 bpm, respectively. In the case of neonates, the average error is 1.5 bpm, which are promising results. The Bland-Altman analysis showed a good agreement of estimated RR with the reference method RR and this pilot study provided the evidence of using the proposed approach as a contactless method for the respiratory rate detection of neonates in clinical settings.

Human respiration monitoring using infrared thermography and artificial intelligence

Infrared thermography-based human respiration monitoring

Infrared Thermography based Human Physiological Parameter Monitoring

Non-contact measurement of human respiration using an infrared thermal camera and the deep learning method

Measurement of Respiration Rate Using Thermal Imaging

A novel method for extracting respiration rate and relative tidal volume from infrared thermography

Real-time Contactless Monitoring of Respiration Rate and Heart Rate Based on Thermal Imaging Technology

Estimation of Heart Rate Variability Parameters by Machine Learning Approaches Applied to Facial Infrared Thermal Imaging

Non-contact respiratory rate monitoring using thermal and visible imaging: a pilot study on neonates

Real-time detection of respiration rate with non-contact mode based on low-end imaging equipment

Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging

Thermal Image Processing for Respiratory Estimation from Cubical Data with Expandable Depth

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

A Detailed Algorithm for Vital Sign Monitoring of a Stationary/Non-Stationary Human through IR-UWB Radar

A Real-Time Respiration Monitoring and Classification System Using a Depth Camera and Radars

Synergetic Use of Thermal and Visible Imaging Techniques for Contactless and Unobtrusive Breathing Measurement

Noncontact Respiratory Anomaly Detection Using Infrared Light-Wave Sensing

Combination of Near-Infrared and Thermal Imaging Techniques for the Remote and Simultaneous Measurements of Breathing and Heart Rates under Sleep Situation.

Respiratory Rate Estimation from Thermal Video Data Using Spatio-Temporal Deep Learning

How Do You Breathe-a Non-Contact Monitoring Method Using Depth Data

Automatic Contact-Less Monitoring of Breathing Rate and Heart Rate Utilizing the Fusion of mmWave Radar and Camera Steering System