Abstract:Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.

Diffusion Model with Self-supervised Training for Subject-aware Photoplethysmography Recovery

Denoising Diffusion Straightforward Models for Energy Conversion Monitoring Data Imputation

Remote physiological signal recovery with efficient spatio-temporal modeling

Stochastic Modeling Based Nonlinear Bayesian Filtering for Photoplethysmography Denoising in Wearable Devices

DiffPhys: Enhancing Signal-to-Noise Ratio in Remote Photoplethysmography Signal Using a Diffusion Model Approach

PPG Signal Reconstruction Using Deep Convolutional Generative Adversarial Network

SimFuPulse: A self-similarity supervised model for remote photoplethysmography extraction from facial videos

Photoplethysmography Motion Artifacts Removal Based on Signal-Noise Interaction Modeling Utilizing Envelope Filtering and Time-Delay Neural Network

Towards Unsupervised Blind Face Restoration using Diffusion Prior

On-Device Reliability Assessment and Prediction of Missing Photoplethysmographic Data Using Deep Neural Networks

Region-Disentangled Diffusion Model for High-Fidelity PPG-to-ECG Translation

Personalized anomaly detection in PPG data using representation learning and biometric identification

Stochastic Modeling for Photoplethysmography Compression

Self-similarity Prior Distillation for Unsupervised Remote Physiological Measurement

Diffusion Posterior Proximal Sampling for Image Restoration

Robust Remote Photoplethysmography Estimation With Environmental Noise Disentanglement

Improving Diffusion Models for ECG Imputation with an Augmented Template Prior

A Self-Supervised Algorithm for Denoising Photoplethysmography Signals for Heart Rate Estimation from Wearables

A spectral-spatial fusion model for robust blood pulse waveform extraction in photoplethysmographic imaging

Non-Contact Heart Rate Measurement from Deteriorated Videos