Abstract:Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.

Thermally responsive shuttling behavior of a pillar[6]arene-based [2]rotaxane.

An image enhancement based method for improving rPPG extraction under low-light illumination

Facial-Video-Based Physiological Signal Measurement: Recent Advances and Affective Applications

GENETIC INVESTIGATIONS OF CENTRAL CORNEAL THICKNESS IN RELATION TO OPEN-ANGLE GLAUCOMA

Remote physiological signal recovery with efficient spatio-temporal modeling

Image Enhancement for Remote Photoplethysmography in a Low-Light Environment

Privacy-Phys: Facial Video-Based Physiological Modification for Privacy Protection

DRNet: Decomposition and Reconstruction Network for Remote Physiological Measurement

Method of Remote Photoplethysmography Robust to Interference in Video Registration of Human Facial Skin

Robust Remote Photoplethysmography Estimation With Environmental Noise Disentanglement

SimFuPulse: A self-similarity supervised model for remote photoplethysmography extraction from facial videos

Region-Disentangled Diffusion Model for High-Fidelity PPG-to-ECG Translation

Standardized rPPG signal generation based on generative adversarial networks

Deep learning and remote photoplethysmography powered advancements in contactless physiological measurement

Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networks

Remote Photoplethysmography With an EEMD-MCCA Method Robust Against Spatially Uneven Illuminations

Deep learning-based remote-photoplethysmography measurement from short-time facial video

A machine learning-based approach for constructing remote photoplethysmogram signals from video cameras

A Plug-and-Play Temporal Normalization Module for Robust Remote Photoplethysmography

Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos

RespDiff: An End-to-End Multi-scale RNN Diffusion Model for Respiratory Waveform Estimation from PPG Signals