Abstract:Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.

Rppg-Hiba:Hierarchical Balanced Framework for Remote Physiological Measurement

PhysBench: A Benchmark Framework for rPPG with a New Dataset and Baseline

Remote physiological signal recovery with efficient spatio-temporal modeling

PhysMLE: Generalizable and Priors-Inclusive Multi-task Remote Physiological Measurement

Resolve Domain Conflicts for Generalizable Remote Physiological Measurement

PhysMamba: State Space Duality Model for Remote Physiological Measurement

The 1st Challenge on Remote Physiological Signal Sensing (Repss)

Remote Heart Rate Measurement from Face Videos under Realistic Situations

AutoHR: A Strong End-to-End Baseline for Remote Heart Rate Measurement With Neural Searching

Remote Bio-Sensing: Open Source Benchmark Framework for Fair Evaluation of rPPG

rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement

BYHE: A Simple Framework for Boosting End-to-end Video-based Heart Rate Measurement Network

SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistency

Video-based Remote Physiological Measurement via Self-supervised Learning

Facial-Video-Based Physiological Signal Measurement: Recent Advances and Affective Applications

rPPG-Toolbox: Deep Remote PPG Toolbox

PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba

The 2nd Challenge on Remote Physiological Signal Sensing (Repss)

Deep Physiological Sensing Toolbox.

MDAR: A Multiscale Features-Based Network for Remotely Measuring Human Heart Rate Utilizing Dual-Branch Architecture and Alternating Frame Shifts in Facial Videos

Facial Video-based Remote Physiological Measurement via Self-supervised Learning