Abstract:Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.

Robust Heart Beat Detection from Photoplethysmography Interlaced with Motion Artifacts Based on Empirical Mode Decomposition.

Heart Rate Estimation Using Wrist-Acquired Photoplethysmography under Different Types of Daily Life Motion Artifact.

Artifact Reduction Based on Empirical Mode Decomposition (emd) in Photoplethysmography for Pulse Rate Detection

A novel motion and Noise Artifacts Reduction Mechanism (MNARM) for wearable PPG-based heart rate extraction

A Motion-resistant Heart Rate Extracting Algorithm Based on Sparse Bayesian Decomposition

Assessment of Photoplethysmogram Signal Quality Using Morphology Integrated with Temporal Information Approach

Spectral Matrix Decomposition-Based Motion Artifacts Removal in Multi-Channel PPG Sensor Signals.

RobustPPG: camera-based robust heart rate estimation using motion cancellation.

Estimation of Heart Rate and Respiratory Rate from PPG Signal Using Complementary Ensemble Empirical Mode Decomposition with both Independent Component Analysis and Non-Negative Matrix Factorization

Remote physiological signal recovery with efficient spatio-temporal modeling

Robust Heart Rate Monitoring for Quasi-Periodic Motions by Wrist-Type PPG Signals

A New Signal Decomposition to Estimate Breathing Rate and Heart Rate from Photoplethysmography Signal.

Combining Nonlinear Adaptive Filtering and Signal Decomposition for Motion Artifact Removal in Wearable Photoplethysmography

Non-Contact Heart Rate Estimation from Photoplethysmography Using EEMD and Convolution-Transformer Network

Adaptive Motion Artifact Reducing Algorithm for Wrist Photoplethysmography Application

Variational Mode Decomposition-Based Heart Rate Estimation Using Wrist-Type Photoplethysmography During Physical Exercise

Robust probabilistic modeling of photoplethysmography signals with application to the classification of premature beats

A New Approach for Heart Rate Monitoring Using Photoplethysmography Signals Contaminated by Motion Artifacts

Detection of heart beats in multimodal data: a robust beat-to-beat interval estimation approach

A Human Ecg Identification System Based On Ensemble Empirical Mode Decomposition

Motion Artifact Reduction In Photoplethysmography For Reliable Signal Selection