A novel non-contact heart rate measurement method based on EEMD combined with FastICA

Yingli Shi,Jian Qiu,Li Peng,Peng Han,Kaiqing Luo,Dongmei Liu

DOI: https://doi.org/10.1088/1361-6579/accefd

2023-04-22

Physiological Measurement

Abstract:Imaging Photoplethysmography (IPPG), Modified EEMD, Modified FastICA, Heart Rate (HR), Multi-region ROI

engineering, biomedical,biophysics,physiology

What problem does this paper attempt to address?

Combining Chrominance Features and Fast ICA for Noncontact Imaging Photoplethysmography.

Ken Cai,Hongwei Yue,Bohan Li,Weitong Chen,Wenhua Huang

DOI: https://doi.org/10.1109/access.2020.2979991

IF: 3.9

2020-01-01

IEEE Access

Abstract:Video-based noncontact detection of heart rate has a wide range of applications in the field of medicine and health. However, this method is susceptible to noise interference, making it difficult to effectively extract blood volume pulse (BVP) signals. To overcome this problem, a new method of noncontact heart rate estimation that can suppress noise interference is proposed in this paper. First, the established data acquisition system conducts video collection, and the captured videos are divided into multiple small regions. Subsequently, the initial signals of BVP are extracted in accordance with the chrominance features extracted through multi-channel data fusion. The BVP signals are separated using the FastICA algorithm. The kurtosis value and signal-to-noise ratios of the power spectrum of the separated signals are analyzed to determine the effective separation component. Results show that this method can extract and process pulse signals, effectively suppressing non-periodic interference. The experiment also proves that the method has good consistency with the measurement of pulse oximeter and has good stability and accuracy in the detection of heart rate of the human body.
Exploring the Feasibility of Seamless Remote Heart Rate Measurement Using Multiple Synchronized Cameras

Cheng Juan,Wang Xingmao,Song Rencheng,Liu Yu,Li Chang,Chen Xun

DOI: https://doi.org/10.1007/s11042-020-09075-2

IF: 2.577

2020-01-01

Multimedia Tools and Applications

Abstract:Heart rate (HR) measurement and monitoring is of great importance to determine the physiological and mental status of individuals. Recently, it has been demonstrated that HR can be remotely retrieved from facial video-based photoplethysmographic signals captured using consumer-grade cameras. However, in existing studies, subjects are mostly required to keep their facial regions of interest (ROIs) within one single camera. To make this technique usable in a daily life situation where subjects move around freely, we launch a preliminary simulated study of seamless remote HR measurement using multiple synchronized cameras by combining ensemble empirical mode decomposition (EEMD) with time-delay canonical correlation analysis (TDCCA), termed as EEMD-TDCCA. At each time point, a target ROI with the largest area is first determined from all the ROIs provided by all the cameras. Then, the RGB time sequence is formed by taking average of all pixels within each target ROI. Afterwards, the green channel time sequence is decomposed into several intrinsic mode functions (IMFs) and only the IMF candidates, whose frequency corresponding to the maximum amplitude falling into the interested HR range will be further processed by TDCCA. Finally, the first pair of the canonical variables having the largest correlation coefficient is the HR source and the corresponding HR is derived by peak detection or frequency analysis. Thirty subjects were recruited and four state-of-the-art methods were employed for comparison. The best performance was achieved by using the proposed EEMD-TDCCA followed by frequency analysis, with the mean absolute error 4.11 bpm, mean percentage error 5.26%, root mean square error 5.37 bpm, the Pearson’s correlation coefficient 0.90 and the intra-class correlation coefficient 0.89, demonstrating the feasibility of our proposed seamless remote HR measurement framework. This study will provide a promising solution for practical and robust non-contact HR measurement applications.
Ghost imaging-based Non-contact Heart Rate Detection

Jianming Yu,Yuchen He,Bin Li,Hui Chen,Huaibin Zheng,Jianbin Liu,Zhuo Xu

2024-06-04

Abstract:Remote heart rate measurement is an increasingly concerned research field, usually using remote photoplethysmography (rPPG) to collect heart rate information through video data collection. However, in certain specific scenarios (such as low light conditions, intense lighting, and non-line-of-sight situations), traditional imaging methods fail to capture image information effectively, that may lead to difficulty or inability in measuring heart rate. To address these limitations, this study proposes using ghost imaging as a substitute for traditional imaging in the aforementioned scenarios. The mean absolute error between experimental measurements and reference true values is 4.24 bpm.Additionally, the bucket signals obtained by the ghost imaging system can be directly processed using digital signal processing techniques, thereby enhancing personal privacy protection.

Image and Video Processing,Medical Physics,Optics
High-accuracy heart rate detection using multispectral IPPG technology combined with a deep learning algorithm

Yu Wang,Yu Ren,Tingting Wang,Dongliang Li,Hongxing Cai,Boyu Ji

DOI: https://doi.org/10.1002/jbio.202400119

Abstract:Image Photoplethysmography (IPPG) technology is a noncontact physiological parameter detection technology, which has been widely used in heart rate (HR) detection. However, traditional imaging devices still have issues such as narrower receiving spectral range and inferior motion detection performance. In this paper, we propose a HR detection method based on multi-spectral video. Our method combining multispectral imaging with IPPG technology provides more accurate physiological information. To realize real-time evaluation of HR directly from facial multispectral videos, we propose a new end-to-end neural network, namely IPPGResNet18. The IPPGResNet18 model was trained on the multispectral video dataset from which better results were achieved: MAE = 2.793, RMSE = 3.695, SD = 3.707, p = 0.304. The experimental results demonstrate a high accuracy of HR detection under motion state using this detection method. In respect of real-time monitoring of HR during movement, our method is obviously superior to the conventional technical solutions.
Remote Photoplethysmography With an EEMD-MCCA Method Robust Against Spatially Uneven Illuminations

Rencheng Song,Jiji Li,Minda Wang,Juan Cheng,Chang Li,Xun Chen

DOI: https://doi.org/10.1109/JSEN.2021.3067770

IF: 4.3

2021-01-01

IEEE Sensors Journal

Abstract:Remote photoplethysmography (rPPG) is an attractive video-based technique to monitor heart rate (HR) information in telehealth screening. The subjects are required to stay stationary in the remote screening scenario and ambient lights become the main interference source of measuring HR with rPPG. In this paper, we introduce a novel approach robust against spatially uneven illumination interference in rPPG by combining ensemble empirical mode decomposition (EEMD) with multiset canonical correlation analysis (MCCA). We adopt the following procedures to ensure that the pulses dominate the correlations across multiple signal sets while the illumination noises are as diverse as possible. Specifically, a group of optimal regions of interest (ROIs) are selected according to the quality indicators defined from the green channel in each candidate ROI. A multi-channel signal set is then constructed by decomposing the green signal with EEMD. Only those intrinsic mode functions (IMFs) with the dominant frequencies falling into the interested HR range are utilized as the input of MCCA. The canonical variables (CVs) with the highest cross correlations are derived as the underlying candidate pulses. Finally, fast Fourier transform (FFT) is employed to calculate the dominant frequency and the target HR is determined based on both the quasi-periodic property and the continuity of HR. The proposed EEMD-MCCA method is validated on both the in-house BSIPL-RPPG and the public COHFACE databases, which achieves superior performance over several typical rPPG methods. This study will provide a promising tool for realistic rPPG applications in telehealth screening.
Motion Resistant Facial Video based Heart Rate Estimation Method using Head-Mounted Camera

Jidong Geng,Chao Zhang,Haoyuan Gao,Yang Lv,Xiaopei Wu

DOI: https://doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData-Cybermatics53846.2021.00047

2021-01-01

Abstract:Imaging photoplethysmography (iPPG) technique has a bright prospect in noncontact heart rate (HR) and other types of vital signs detection; however, the iPPG method is highly susceptible to the motion artifacts in blood volume pulse (BVP) detected from facial video, and this is crucial for HR estimation. Although a number of signal processing algorithms regarding the resistance to motion interference have been proposed in recent years, their stability and computational complexity are hard to meet the requirements of practical applications. To address this problem, we suggest using the head-mounted camera (HMC) instead of a fixed position camera (FPC) in iPPG method because the HMC can move synchronously with the head, which can effectively alleviate the impact of motion artifacts. To this end, a prototype of HMC was designed and implemented. By referring to the results of CMS50E pulse oximeter synchronized with the subject's videos, the comparison study of HMC and FPC in iPPG-based HR estimation was conducted in three scenarios of resting, talking and head rotation. Furthermore, a HMC-based iPPG database named IPPG-HMC database was built. The experimental results show that HMC-based iPPG methods can deal with motion artifacts efficiently, and significantly improve the reliability and accuracy of HR estimation.
A Novel Heart Rate Robust Method For Short-Term Electrocardiogram Biometric Identification

Di Wang,Yujuan Si,Weiyi Yang,Gong Zhang,Tong Liu

DOI: https://doi.org/10.3390/app9010201

2019-01-01

Abstract:In the past decades, the electrocardiogram (ECG) has been investigated as a promising biometric by exploiting the subtle discrepancy of ECG signals between subjects. However, the heart rate (HR) for one subject may vary because of physical activities or strong emotions, leading to the problem of ECG signal variation. This variation will significantly decrease the performance of the identification task. Particularly for short-term ECG signal without many heartbeats, the hardly measured HR makes the identification task even more challenging. This study aims to propose a novel method suitable for short-term ECG signal identification. In particular, an improved HR-free resampling strategy is proposed to minimize the influence of HR variability during heartbeat processing. For feature extraction, the Principal Component Analysis Network (PCANet) is implemented to determine the potential difference between subjects. The proposed method is evaluated using a public ECG-ID database that contains various HR data for some subjects. Experimental results show that the proposed method is robust to HR change and can achieve high subject identification accuracy (94.4%) on ECG signals with only five heartbeats. Thus, the proposed method has the potential for application to systems that use short-term ECG signals for identification (e.g., wearable devices).
An iPPG-Based Device for Pervasive Monitoring of Multi-Dimensional Cardiovascular Hemodynamics

Jingjing Luo,Junjie Zhen,Peng Zhou,Wei Chen,Yuzhu Guo

DOI: https://doi.org/10.3390/s21030872

IF: 3.9

2021-01-28

Sensors

Abstract:Hemodynamic activities, as an essential measure of physiological and psychological characteristics, can be used for cardiovascular and cerebrovascular disease detection. Photoplethysmography imaging (iPPG) can be applied for such purposes with non-contact advances, however, most cardiovascular hemodynamics of iPPG systems are developed for laboratory research, which limits the application in pervasive healthcare. In this study, a video-based facial iPPG detecting equipment was devised to provide multi-dimensional spatiotemporal hemodynamic pulsations for applications with high portability and self-monitoring requirements. A series of algorithms have also been developed for physiological indices such as heart rate and breath rate extraction, facial region analysis, and visualization of hemodynamic pulsation distribution. Results showed that the new device can provide a reliable measurement of a rich range of cardiovascular hemodynamics. Combined with the advanced computing techniques, the new non-contact iPPG system provides a promising solution for user-friendly pervasive healthcare.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
An Efficient Non-Contact Heart Rate Measurement Based on CIELab Color Space

Jiaxin Wang,Philip O. Ogunbona,Jianmin Han,Bangbing Wang

2018-01-01

Abstract:Remote photoplethysmography (rPPG) provides an approach of non-contact heart rate measurement, which can be used in natural light conditions to record human face video using an ordinary camera. However, this kind of experiment is currently sensitive to illumination, movement and skin color. In this paper, we introduce a simple and robust heart rate signal extraction method, by converting to CIELab color space as well as using a* channel to extract the original signal, rather than commonly used RGB space and g* channel. We utilized MAHNOB-HCI-TAGGING Database and self-built dataset to evaluate the results. Compared with g* channels, using a* channel in CIELab color space achieved higher accuracy, with the error rate reduced by 4.85%. The design has the characteristics of fast and convenient operation, with low cost and non-contact feature, that are suitable for a wider monitoring heart rate in daily life.
Non-Contact Heart Rate Monitoring In Neonatal Intensive Care Unit Using Rgb Camera

Qiong Chen,Xinyu Jiang,Xiangyu Liu,Chunmei Lu,Laishuan Wang,Wei Chen

DOI: https://doi.org/10.1109/EMBC44109.2020.9175651

2020-01-01

Abstract:Heart rate (HR) measurement is crucial for newborn infant monitoring in the neonatal intensive care unit (NICU). The widely used contact HR measurement methods based on electrocardiography (ECG) and photoplethysmography (PPG) signals can lead to discomfort and possible skin irritation on neonates, which limit its application in NICU scenarios. In this work, we propose a non-contact HR monitoring method simply using a RGB camera. Eulerian video magnification (EVM) is employed to detect the subtle changes of neonatal faces results from blood circulation. The magnified signal is then transformed to the spectral domain to extract HR information. Compared with the widely investigated independent component analysis (ICA)-based HR measurement method using video recordings, the proposed method can achieve the real time HR measurement, which is a significant superiority in NICU neonatal monitoring. To the best of our knowledge, this is the first study to employ EVM algorithm in real time neonatal HR monitoring.
Automatic webcam-based human heart rate measurements using laplacian eigenmap

Lan Wei,Yonghong Tian,Yaowei Wang,Touradj Ebrahimi,Tiejun Huang

DOI: https://doi.org/10.1007/978-3-642-37444-9_22

2012-01-01

Abstract:Non-contact, long-term monitoring human heart rate is of great importance to home health care. Recent studies show that Photoplethysmography (PPG) can provide a means of heart rate measurement by detecting blood volume pulse (BVP) in human face. However, most of existing methods use linear analysis method to uncover the underlying BVP, which may be not quite adequate for physiological signals. They also lack rigorous mathematical and physiological models for the subsequent heart rate calculation. In this paper, we present a novel webcam-based heart rate measurement method using Laplacian Eigenmap (LE). Usually, the webcam captures the PPG signal mixed with other sources of fluctuations in light. Thus exactly separating the PPG signal from the collected data is crucial for heart rate measurement. In our method, more accurate BVP can be extracted by applying LE to efficiently discover the embedding ties of PPG with the nonlinear mixed data. We also operate effective data filtering on BVP and get heart rate based on the calculation of interbeat intervals (IBIs). Experimental results show that LE obtains higher degrees of agreement with measurements using finger blood oximetry than Independent Component Analysis (ICA), Principal Component Analysis (PCA) and other five alternative methods. Moreover, filtering and processing on IBIs are proved to increase the measuring accuracy in experiments.
Frequency-Enhanced Geometric-Constrained Reconstruction for Localizing Myocardial Infarction in 12-Lead Electrocardiograms

Shichang Lian,Zhifan Gao,Hui Wang,Xiujian Liu,Lei Xu,Huafeng Liu,Heye Zhang

DOI: https://doi.org/10.1109/tbme.2024.3382050

IF: 4.6

2024-01-01

IEEE Transactions on Biomedical Engineering

Abstract:Determining the location of myocardial infarction is crucial for clinical management and therapeutic stratagem. However, existing diagnostic tools either sacrifice ease of use or are limited by their spatial resolution. Addressing this, we aim to refine myocardial infarction localization via surface potential reconstruction of the ventricles in 12-lead electrocardiograms (ECG). A notable obstacle is the ill-posed nature of such reconstructions. To overcome this, we introduce the frequency-enhanced geometric-constrained iterative network (FGIN). FGIN begins by mining the latent features from ECG data across both time and frequency domains. Subsequently, it increases the data dimensionality of ECG and captures intricate features using convolutional layers. Finally, FGIN incorporates ventricular geometry as a constraint on surface potential distribution. It allocates variable weights to distinct edges. Experimental validation of FGIN confirms its efficacy over synthetic and clinical datasets. On the synthetic dataset, FGIN outperforms seven existing reconstruction methods, attaining the highest Pearson Correlation Coefficient of 0.8624, the lowest Root Mean Square Error of 0.1548, and the highest Structural Similarity Index Measure of 0.7988. On the clinical public dataset (2007 PhysioNet/Computers in Cardiology Challenge), FGIN achieves better localization results than other approaches, according to the clinical standard 17-segment model, achieving an average Segment Overlap of 87.2%. Clinical trials on 50 patients demonstrate FGIN's effectiveness, showing an average accuracy of 91.6% and an average Segment Overlap of 88.2%.
Physiology and Geometry-Informed Deep Learning Framework for 12-Lead ECG Cardiac Transmembrane Potential Recovery

Shujin Hu,Huafeng Liu,Huihui Ye

DOI: https://doi.org/10.1145/3655497.3655505

2024-01-01

Abstract:The recovery of cardiac transmembrane potential (TMP) from body surface potential (BSP) or so-called electrocardiogram imaging (ECGI) is a critical non-invasive reconstruction technique with significant implications for clinical guidance in cardiac disease diagnosis. Existing non-invasive methods often rely on electrocardiogram (ECG) from large number of leads (64-256 leads), of which is not as affordable and user-friendly as 12-lead ECG. In this study, we propose to use 12-lead ECG to recover patient-specific TMP patterns with our proposed physiology and geometry-informed deep learning framework for accurate non-invasive reconstruction, offering a more cost-effective and convenient alternative as compared to current methods. Specifically, we introduce a deep learning framework that integrates attention mechanisms and graph convolution network (GCN) to learn patient-specific TMP temporal and spatial characteristics. Additionally, we introduce a transfer matrix H, which is derived from the specific geometric model, to facilitate the inverse reconstruction of TMP. Through a series of simulation experiments, our method shows low mean square error (MSE) of 0.018, high correlation coefficient (CC) of 0.952, and substantial dice correlation (DC) of 0.676, which validate our model in accurately reconstructing patient-specific TMP from 12-lead ECG data. We also validate our method on 6 patient (with myocardial infarction) data and it shows good accordance in infraction detection from our proposed method and that with MRI.
Heart rate estimation based on face video under unstable illumination

Ruo-Nan Yin,Rui-Sheng Jia,Zhe Cui,Jin-Tao Yu,Yan-Bin Du,Li Gao,Hong-Mei Sun

DOI: https://doi.org/10.1007/s10489-020-02167-4

IF: 5.3

2021-01-08

Applied Intelligence

Abstract:Remote photoplethysmography (rPPG) is a noncontact heart rate (HR) measurement technique. The current heart rate measurement methods based on rPPG all require ideal lighting conditions, but the lighting in real scenes is complicated, Therefore, this article proposes a robust heart rate measurement method when unstable light (time-varying light and uneven spatial illumination) exists. First, the method locates the ROI(Region of Interest) area of the face, divides it into blocks, and uses the color signals of different sub-blocks to establish a three-dimensional rPPG model. Second, the method performs logarithmic operations on each frame of the image to convert the relationship between the illumination component and the reflection component from a product to a sum so that the reflected component and noise can be separated in the frequency domain. Then, the ensemble empirical mode decomposition (EEMD) is used to decompose the reflected component, and the obtained intrinsic mode function (IMF) is applied to obtain the waveform reflecting the change in the heart rate. Finally, the signal quality (SQ) of each ROI sub-block is calculated, and the high-quality signals are combined to reconstruct the heart rate signal.

computer science, artificial intelligence
Review Of Non-Contact, Low-Cost Physiological Information Measurement Based On Photoplethysmographic Imaging

He Liu,Yadong Wang,Lei Wang

DOI: https://doi.org/10.1109/EMBC.2012.6346371

2012-01-01

Abstract:In recent decades, there has been increasing interest in low-cost, non-contact and pervasive methods for measuring physiological information, such as heart rate (HR), respiratory rate, heart rate variability (HRV) and oxyhemoglobin saturation. The conventional methods including wet adhesive Ag/AgCl electrodes for HR and HRV, the capnograph device for respiratory status and pulse oximetry for oxyhemoglobin saturation provide excellent signals but are expensive, troublesome and inconvenient. A method to monitor physiological information based on photoplethysmographic imaging offers a new means for health monitoring. Blood volume can be indirectly assessed in terms of blood velocity, blood flow rate and blood pressure, which, in turn, can reflect changes in physiological parameters. Changes in blood volume can be determined from the spectra of light reflected from or transmitted through body tissues. Images of an area of the skin surface are consecutively captured with the color camera of a computer or smartphone and, by processing and analyzing the light signals, physiological information such as HR, respiratory rate, HRV and oxyhemoglobin saturation can be acquired. In this paper, we review the latest developments in using photoplethysmographic imaging for non-contact health monitoring and discuss the challenges and future directions for this field.
A novel algorithm based on hanning-windowed tri-section independent component analysis for remote heart rate detection

Haitao Chen,Qinyuan Wei,Lai Wei,Xiaohui Duan

2018-01-01

Abstract:Non-contact heart rate detection can simplify physiological parameters measurement without the invasion of electrodes. In this paper, we provide a novel algorithm based on Hanning Window and Independent Component Analysis (ICA), analysing the frequency spectrum of triple regions of interest (ROI) of human face images obtained from a digital webcam. We use Bland-Altman and correlation analysis to compare the results of our algorithm and reference electro-cardiogram signals obtained from a calibration system. It demonstrates that our algorithm performs well and gets a correlation coefficient of 0.974.
A Review of the Methods for Non-Contact, Low-cost Acquisition of Physiological Information Based on Photoplethysmographic Imaging

LIU He,WANG Ya-dong,WANG Lei

DOI: https://doi.org/10.1109/embc.2012.6346371

2012-01-01

Journal of Integration Technology

Abstract:In recent decades, there has been increasing interest in low-cost, non-contact and pervasive methods for measuring physiological information, such as heart rate (HR), respiratory rate, heart rate variability (HRV) and oxyhemoglobin saturation. The conventional methods including wet adhesive Ag/AgCl electrodes for HR and HRV, the capnograph device for respiratory status and pulse oximetry for oxyhemoglobin saturation provide excellent signals but are expensive, troublesome and inconvenient. A method to monitor physiological information based on photoplethysmographic imaging offers a new means for health monitoring. Blood volume can be indirectly assessed in terms of blood velocity, blood flow rate and blood pressure, which, in turn, can reflect changes in physiological parameters. Changes in blood volume can be determined from the spectra of light reflected from or transmitted through body tissues. Images of an area of the skin surface are consecutively captured with the color camera of a computer or smartphone and, by processing and analyzing the light signals, physiological information such as HR, respiratory rate, HRV and oxyhemoglobin saturation can be acquired. In this paper, we review the latest developments in using photoplethysmographic imaging for non-contact health monitoring and discuss the challenges and future directions for this field.
Motion Robust Remote Photoplethysmography Measurement During Exercise for Contactless Physical Activity Intensity Detection

Yi-Chiao Wu,Li-Wen Chiu,Bing-Fei Wu,Linda Li-Chuan Lin,Tsai-Hsuan Ho,Meng-Liang Chung,Shou-Fang Wu

DOI: https://doi.org/10.1109/tim.2023.3256470

IF: 5.6

2023-04-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Monitoring the subject's physical activity intensity (PAI) is key to preventing sports injury and enhancing conditioning performance. Existing monitoring equipment can be cumbersome and is not always accessible in daily situations due to cost or usability. For ease of usage, we propose a motion robust remote photoplethysmography (rPPG) measurement during exercise for contactless PAI detection. To account for vigorous motion during physical exercise, we leverage signal holding with motion analysis to maintain the consistency of the signal source. We then obtain robust rPPG signals via a convolutional neural network (CNN)-based rPPG constructor module composed of a dual feature extractor with signal-based targets, a base span module, and a noise elimination module. In terms of the PAI detection application, as changes in heart rate are a dominant biomarker during exercise, this is applied to estimate the training level for PAI detection. In this study, training status is classified into three levels and is estimated via a residual-learning-based architecture with sequential heart rate input. In terms of heart rate measurements, the proposed method outperforms the state-of-the-art approaches in motion scenarios on both ECG-Fitness and our own exercise datasets. The mean absolute error (MAE) is reduced to about one-third of the comparison methods in real-world treadmill running scenarios, and the error level goes down by about 30% in the ECG-Fitness dataset under a cross-dataset evaluation. In addition, for follow-up PAI detection applications, the heart rate values estimated with the proposed method approximate the heart rate ground truth. It is capable to represent the trend between training load and PAI changes. We propose a novel framework for the motion robust rPPG measurement during exercise applied to PAI detection, with which overall athlete assessment can be accomplished as a convenient alternative to existing athlete moni- oring equipment.

engineering, electrical & electronic,instruments & instrumentation
Non-contact, synchronous dynamic measurement of respiratory rate and heart rate based on dual sensitive regions

Bing Wei,Xuan He,Chao Zhang,Xiaopei Wu

DOI: https://doi.org/10.1186/s12938-016-0300-0

2017-01-17

BioMedical Engineering OnLine

Abstract:BackgroundCurrently, many imaging photoplethysmography (IPPG) researches have reported non-contact measurements of physiological parameters, such as heart rate (HR), respiratory rate (RR), etc. However, it is accepted that only HR measurement has been mature for applications, and other estimations are relatively incapable for reliable applications. Thus, it is worth keeping on persistent studies. Besides, there are some issues commonly involved in these approaches need to be explored further. For example, motion artifact attenuation, an intractable problem, which is being attempted to be resolved by sophisticated video tracking and detection algorithms.MethodsThis paper proposed a blind source separation-based method that could synchronously measure RR and HR in non-contact way. A dual region of interest on facial video image was selected to yield 6-channels Red/Green/Blue signals. By applying Second-Order Blind Identification algorithm to those signals generated above, we obtained 6-channels outputs that contain blood volume pulse (BVP) and respiratory motion artifact. We defined this motion artifact as respiratory signal (RS). For the automatic selections of the RS and BVP among these outputs, we devised a kurtosis-based identification strategy, which guarantees the dynamic RR and HR monitoring available.ResultsThe experimental results indicated that, the estimation by the proposed method has an impressive performance compared with the measurement of the commercial medical sensors.ConclusionsThe proposed method achieved dynamic measurement of RR and HR, and the extension and revision of it may have the potentials for more physiological signs detection, such as heart rate variability, eye blinking, nose wrinkling, yawn, as well as other muscular movements. Thus, it might provide a promising approach for IPPG-based applications such as emotion computation and fatigue detection, etc.

engineering, biomedical
EVM-CNN: Real-Time Contactless Heart Rate Estimation from Facial Video

Ying Qiu,Yang Liu,Juan Arteaga-Falconi,Haiwei Dong,Abdulmotaleb El Saddik

DOI: https://doi.org/10.1109/TMM.2018.2883866

2022-12-25

Abstract:With the increase in health consciousness, noninvasive body monitoring has aroused interest among researchers. As one of the most important pieces of physiological information, researchers have remotely estimated the heart rate (HR) from facial videos in recent years. Although progress has been made over the past few years, there are still some limitations, like the processing time increasing with accuracy and the lack of comprehensive and challenging datasets for use and comparison. Recently, it was shown that HR information can be extracted from facial videos by spatial decomposition and temporal filtering. Inspired by this, a new framework is introduced in this paper to remotely estimate the HR under realistic conditions by combining spatial and temporal filtering and a convolutional neural network. Our proposed approach shows better performance compared with the benchmark on the MMSE-HR dataset in terms of both the average HR estimation and short-time HR estimation. High consistency in short-time HR estimation is observed between our method and the ground truth.

Computer Vision and Pattern Recognition,Multimedia

A novel non-contact heart rate measurement method based on EEMD combined with FastICA

Combining Chrominance Features and Fast ICA for Noncontact Imaging Photoplethysmography.

Exploring the Feasibility of Seamless Remote Heart Rate Measurement Using Multiple Synchronized Cameras

Ghost imaging-based Non-contact Heart Rate Detection

High-accuracy heart rate detection using multispectral IPPG technology combined with a deep learning algorithm

Remote Photoplethysmography With an EEMD-MCCA Method Robust Against Spatially Uneven Illuminations

Motion Resistant Facial Video based Heart Rate Estimation Method using Head-Mounted Camera

A Novel Heart Rate Robust Method For Short-Term Electrocardiogram Biometric Identification

An iPPG-Based Device for Pervasive Monitoring of Multi-Dimensional Cardiovascular Hemodynamics

An Efficient Non-Contact Heart Rate Measurement Based on CIELab Color Space

Non-Contact Heart Rate Monitoring In Neonatal Intensive Care Unit Using Rgb Camera

Automatic webcam-based human heart rate measurements using laplacian eigenmap

Frequency-Enhanced Geometric-Constrained Reconstruction for Localizing Myocardial Infarction in 12-Lead Electrocardiograms

Physiology and Geometry-Informed Deep Learning Framework for 12-Lead ECG Cardiac Transmembrane Potential Recovery

Heart rate estimation based on face video under unstable illumination

Review Of Non-Contact, Low-Cost Physiological Information Measurement Based On Photoplethysmographic Imaging

A novel algorithm based on hanning-windowed tri-section independent component analysis for remote heart rate detection

A Review of the Methods for Non-Contact, Low-cost Acquisition of Physiological Information Based on Photoplethysmographic Imaging

Motion Robust Remote Photoplethysmography Measurement During Exercise for Contactless Physical Activity Intensity Detection

Non-contact, synchronous dynamic measurement of respiratory rate and heart rate based on dual sensitive regions

EVM-CNN: Real-Time Contactless Heart Rate Estimation from Facial Video