Abstract:Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.

Reconstruction of Physiological Signals Using Iterative Retraining and Accumulated Averaging of Neural Network Models

Application of kernel principal component analysis and support vector regression for reconstruction of cardiac transmembrane potentials.

Noninvasive Reconstruction of Cardiac Transmembrane Potentials Using A Kernelized Extreme Learning Method

ECG Signal Reconstruction Based on Facial Videos Via Combined Explicit and Implicit Supervision.

Physiology and Geometry-Informed Deep Learning Framework for 12-Lead ECG Cardiac Transmembrane Potential Recovery

Reconstruction of Missing Electrocardiography Signals from Photoplethysmography Data Using Deep Neural Network

Physiological Model Based Deep Learning Framework for Cardiac TMP Recovery

A Stochastic Modelling Framework for the Reconstruction of Cardiovascular Signals

Real-Time Cardiac Abnormality Monitoring and Nursing for Patient Using Electrocardiographic Signals

Repairing Artifacts in Neural Activity Recordings Using Low-Rank Matrix Estimation

UNet-BiLSTM: A Deep Learning Method for Reconstructing Electrocardiography from Photoplethysmography

Combining Hough Transform and Deep Learning Approaches to Reconstruct ECG Signals From Printouts

Subject-Independent Model for Reconstructing Electrocardiography Signals from Photoplethysmography Signals

ECGrecover: a Deep Learning Approach for Electrocardiogram Signal Completion

Real-Time Compressed Sensing Reconstruction for Wearable Physiological Signals

Feasibility and validity of using deep learning to reconstruct 12-lead ECG from three‑lead signals

Remote physiological signal recovery with efficient spatio-temporal modeling

Predictive Modeling of Biomedical Signals Using Controlled Spatial Transformation

Robust Reconstruction of Electrocardiogram Using Photoplethysmography: A Subject-Based Model

3-Lead to 12-Lead ECG Reconstruction: A Novel AI-based Spatio-Temporal Method

Deep learning neural nets for detecting heart activity