Abstract:Contactless physiological signal measurement has great applications in various fields, such as affective computing and health monitoring. Physiological measurements based on remote photoplethysmography (rPPG) are realized by capturing the weak periodic color changes. The changes are caused by the variation in the light absorption of skin surface during systole and diastole stages of a functioning heart. This measurement mode has advantages of contactless measurement, simple operation, low cost, etc. In recent years, several deep learning-based rPPG measurement methods have been proposed. However, the features learned by deep learning models are vulnerable to motion and illumination artefacts, and are unable to fully exploit the intrinsic temporal characteristics of the rPPG. This paper presents an efficient spatiotemporal modeling-based rPPG recovery method for physiological signal measurements. First, two modules are utilized in the rPPG task: 1) 3D central difference convolution for temporal context modeling with enhanced representation and generalization capacity, and 2) Huber loss for robust intensity-level rPPG recovery. Second, a dual branch structure for both motion and appearance modeling and a soft attention mask are adapted to take full advantage of the central difference convolution. Third, a multi-task setting for joint cardiac and respiratory signals measurements is introduced to benefit from the internal relevance between two physiological signals. Last, extensive experiments performed on three public databases show that the proposed method outperforms prior state-of-the-art methods with the Pearson's correlation coefficient higher than 0.96 on all three datasets. The generalization ability of the proposed method is also evaluated by cross-database and video compression experiments. The effectiveness and necessity of each module are confirmed by ablation studies.

Pulse shape discrimination based on the Tempotron: a powerful classifier on GPU

Pulse Shape Discrimination Based on the Tempotron: A Powerful Classifier on GPU

High-Performance Personalized Heartbeat Classification Model for Long-Term ECG Signal

A Real-Time Spike Sorting Method Based on the Embedded GPU

Graphics processing unit (GPU)-accelerated particle filter framework for positron emission tomography image reconstruction.

A Study on the Implementation of Temporal Noise-Robust Methods for Acquiring Vital Signs

Enhancing Coincidence Time Resolution of PET Detectors Using Short-Time Fourier Transform and Residual Neural Network

PulseNet: A multitask learning network for remote heart rate estimation

Dataset for neutron and gamma-ray pulse shape discrimination

LMPDNet: TOF-PET List-Mode Image Reconstruction Using Model-Based Deep Learning Method.

Pulse Shape Simulation and Discrimination using Machine-Learning Techniques

GPU Implementation of the Improved CEEMDAN Algorithm for Fast and Efficient EEG Time–Frequency Analysis

Convolutional neural network with spatio-temporal-channel attention for remote heart rate estimation

A Generalized Transformer-Based Pulse Detection Algorithm

A Plug-and-Play Temporal Normalization Module for Robust Remote Photoplethysmography

PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer

A novel one-stage framework for visual pulse rate estimation using deep neural networks

Remote physiological signal recovery with efficient spatio-temporal modeling

An effective cross-scenario remote heart rate estimation network based on global-local information and video transformer

The MSPTDfast photoplethysmography beat detection algorithm: Design, benchmarking, and open-source distribution

Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices