Abstract:Heart rate (HR) measurement and monitoring is of great importance to determine the physiological and mental status of individuals. Recently, it has been demonstrated that HR can be remotely retrieved from facial video-based photoplethysmographic signals captured using consumer-grade cameras. However, in existing studies, subjects are mostly required to keep their facial regions of interest (ROIs) within one single camera. To make this technique usable in a daily life situation where subjects move around freely, we launch a preliminary simulated study of seamless remote HR measurement using multiple synchronized cameras by combining ensemble empirical mode decomposition (EEMD) with time-delay canonical correlation analysis (TDCCA), termed as EEMD-TDCCA. At each time point, a target ROI with the largest area is first determined from all the ROIs provided by all the cameras. Then, the RGB time sequence is formed by taking average of all pixels within each target ROI. Afterwards, the green channel time sequence is decomposed into several intrinsic mode functions (IMFs) and only the IMF candidates, whose frequency corresponding to the maximum amplitude falling into the interested HR range will be further processed by TDCCA. Finally, the first pair of the canonical variables having the largest correlation coefficient is the HR source and the corresponding HR is derived by peak detection or frequency analysis. Thirty subjects were recruited and four state-of-the-art methods were employed for comparison. The best performance was achieved by using the proposed EEMD-TDCCA followed by frequency analysis, with the mean absolute error 4.11 bpm, mean percentage error 5.26%, root mean square error 5.37 bpm, the Pearson’s correlation coefficient 0.90 and the intra-class correlation coefficient 0.89, demonstrating the feasibility of our proposed seamless remote HR measurement framework. This study will provide a promising solution for practical and robust non-contact HR measurement applications.

Non-Contact Time Varying Heart Rate Monitoring In Exercise By Video Camera

Non-contact Measurement of Heart Rate Based on Facial Video

Non-contact Heart Rate Monitoring for Intensive Exercise Based on Singular Spectrum Analysis

Non-contact Real-time Heart Rate Measurements Based on High Speed Circuit Technology Research

Human Heart Rate Estimation Using Ordinary Cameras under Natural Movement.

Heart rate measurement based on face video sequence

A New Approach to HR Monitoring Using Photoplethysmographic Signals During Intensive Physical Exercise

Remote Heart Rate Measurement from Face Videos under Realistic Situations

Real-time and Robust Heart Rate Measurement for Multi-People in Motion Using IPPG

Motion Resistant Facial Video based Heart Rate Estimation Method using Head-Mounted Camera

Continuous Distant Measurement of the User's Heart Rate in Human-Computer Interaction Applications

A Camera-Based Pulse Transit Time Estimation Approach Towards Non-Intrusive Blood Pressure Monitoring.

A Real-Time and Non-contact Pulse Rate Measurement System on Fitness Equipment

Exploring the Feasibility of Seamless Remote Heart Rate Measurement Using Multiple Synchronized Cameras

Video-Based Heart Rate Measurement: Recent Advances and Future Prospects.

Video-based Human Heart Rate Measurement Using Joint Blind Source Separation

Non-Contact Simultaneous Photoplethysmogram and Ballistocardiogram Video Recording Towards Real-time Blood Pressure and Abnormal Heart Rhythm Monitoring

Non-contact heart rate estimation based on singular spectrum component reconstruction using low-rank matrix and autocorrelation

Study on Real-Time Heart Rate Detection Based on Multi-People

A camera-based ballistocardiogram heart rate measurement method

Efficient Real-Time Camera Based Estimation of Heart Rate and Its Variability