Abstract:Respiratory rate (RR) monitoring is essential in neonatal intensive care units. Despite its importance, RR is still monitored intermittently by manual counting instead of continuous monitoring due to the risk of skin damage with prolonged use of contact electrodes in preterm neonates and false signals due to displacement of electrodes. Thermal imaging has recently gained significance as a non-contact method for RR detection because of its many advantages. However, due to the lack of information in thermal images, the selection and tracking of the region of interest (ROI) in thermal images for neonates are challenging. This paper presents the integration of visible (RGB) and thermal (T) image sequences for the selection and tracking of ROI for breathing rate extraction. The deep-learning based tracking-by-detection approach is employed to detect the ROI in the RGB images, and it is mapped to the thermal images using the RGB-T image registration. The mapped ROI in thermal spectrum sequences gives the respiratory rate. The study was conducted first on healthy adults in different modes, including steady, motion, talking, and variable respiratory order. Subsequently, the method is tested on neonates in a clinical settings. The findings have been validated with a contact-based reference method.The average absolute error between the proposed and belt-based contact method in healthy adults reached 0.1 bpm and for more challenging conditions was approximately 1.5 bpm and 1.8 bpm, respectively. In the case of neonates, the average error is 1.5 bpm, which are promising results. The Bland-Altman analysis showed a good agreement of estimated RR with the reference method RR and this pilot study provided the evidence of using the proposed approach as a contactless method for the respiratory rate detection of neonates in clinical settings.

RGB-thermal Imaging System Collaborated with Marker Tracking for Remote Breathing Rate Measurement.

Collaborative use of RGB and thermal imaging for remote breathing rate measurement under realistic conditions

Combination of Near-Infrared and Thermal Imaging Techniques for the Remote and Simultaneous Measurements of Breathing and Heart Rates under Sleep Situation.

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Influence of Image Resolution on the Performance of Remote Breathing Rate Measurement Using Thermal Imaging Technique

ROI Detection and Tracking for Physiological Monitoring Based on Calibration between RGB-D and Thermal Cameras

Non-contact respiratory rate monitoring using thermal and visible imaging: a pilot study on neonates

Remote Heart Rate Measurement from Face Videos under Realistic Situations

Revisiting Motion-Based Respiration Measurement from Videos

Synergetic Use of Thermal and Visible Imaging Techniques for Contactless and Unobtrusive Breathing Measurement

An Unobtrusive and Non-Contact Method for Respiratory Measurement with Respiratory Region Detecting Algorithm Based on Depth Images.

Estimating Carotid Pulse and Breathing Rate from Near-infrared Video of the Neck

For a clinical application of optical triangulation to assess respiratory rate using an RGB camera and a line laser

[Research on non-contact respiratory rate measurement method based on video information].

Remote Heart Rate Measurement From Near-Infrared Videos Based on Joint Blind Source Separation With Delay-Coordinate Transformation

Thermal Image Processing for Respiratory Estimation from Cubical Data with Expandable Depth

Dual-mode imaging system for non-contact heart rate estimation during night

Non-contact measurement of human respiration using an infrared thermal camera and the deep learning method

Non-Contact Respiratory Monitoring Using an RGB Camera for Real-World Applications

Low-Cost and Unobtrusive Respiratory Condition Monitoring Based on Raspberry Pi and Recurrent Neural Network.

Measurement of Respiration Rate Using Thermal Imaging