Abstract:Remote photoplethysmography (rPPG) is a video-based non-contact heart rate measurement technology. It is a fact that most existing rPPG methods fail to deal with the spatiotemporal features of the video, which is significant for the extraction of the rPPG signal. In this paper, we propose a 3D central difference convolutional network (CDCA-rPPGNet) to measure heart rate, with an attention mechanism to combine spatial and temporal features. First, we crop and stitch the region of interest together through facial landmarks. Next, the high-quality regions of interest are fed to CDCA-rPPGNet based on a central difference convolution, which can enhance the spatiotemporal representation and capture rich relevant time contexts by collecting time difference information. In addition, we integrate the attention module into the neural network, aiming to strengthen the ability of the neural network to extract video channels and spatial features, so as to obtain more accurate rPPG signals. In summary, the three main contributions of this paper are as follows: (1) the proposed network base on central difference convolution could better capture the subtle color changes to recover the rPPG signals; (2) the proposed ROI extraction method provides high-quality input to the network; (3) the attention module is used to strengthen the ability of the network to extract features. Extensive experiments are conducted on two public datasets-the PURE dataset and the UBFC-rPPG dataset. In terms of the experiment results, our proposed method achieves 0.46 MAE (bpm), 0.90 RMSE (bpm) and 0.99 R value of Pearson's correlation coefficient on the PURE dataset, and 0.60 MAE (bpm), 1.38 RMSE (bpm) and 0.99 R value of Pearson's correlation coefficient on the UBFC dataset, which proves the effectiveness of our proposed approach.

CDCCA-RPPGFormer: Transformer-Like Network Based on 3D-CDC-ST and ECA for Remote Heart Rate Measurement

STFMRPPGFormer:Vision Transformer Network Based on MLP-3D and STFM for Remote Heart Rate Measurement

Heart Rate Measurement Based on 3D Central Difference Convolution with Attention Mechanism

Non-Contact Heart Rate Estimation from Photoplethysmography Using EEMD and Convolution-Transformer Network

CoSTHR: A Heart Rate Estimating Network with Adaptive Color Space Transformation

Convolutional neural network with spatio-temporal-channel attention for remote heart rate estimation

An effective cross-scenario remote heart rate estimation network based on global-local information and video transformer

TransPPG: Two-stream Transformer for Remote Heart Rate Estimate

TCNTransNet: A Semi-Supervised Temporal-Spatial Fusion Framework for Heart Rate Estimation from Camera Video

PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer

TranPhys: Spatiotemporal Masked Transformer Steered Remote Photoplethysmography Estimation

Heart Rate Estimation From Facial Videos Using a Spatiotemporal Representation With Convolutional Neural Networks

ETA-rPPGNet: Effective Time-Domain Attention Network for Remote Heart Rate Measurement.

Multi-hierarchical Convolutional Network for Efficient Remote Photoplethysmograph Signal and Heart Rate Estimation from Face Video Clips.

TransPhys: Transformer-based unsupervised contrastive learning for remote heart rate measurement

ACTNet: Attention based CNN and Transformer network for respiratory rate estimation

A Feasibility Study of a Video-Based Heart Rate Estimation Method with Convolutional Neural Networks

PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer

Rppg-Based Heart Rate Estimation Using Spatial-Temporal Attention Network

Demodulation Based Transformer for rPPG Generation and Heart Rate Estimation

Efficient Spatiotemporal Attention Network for Remote Heart Rate Variability Analysis