Abstract:Wrist-worn smart devices are providing increased insights into human health, behaviour and performance through sophisticated analytics. However, battery life, device cost and sensor performance in the face of movement-related artefact present challenges which must be further addressed to see effective applications and wider adoption through commoditisation of the technology. We address these challenges by demonstrating, through using a simple optical measurement, photoplethysmography (PPG) used conventionally for heart rate detection in wrist-worn sensors, that we can provide improved heart rate and human activity recognition (HAR) simultaneously at low sample rates, without an inertial measurement unit. This simplifies hardware design and reduces costs and power budgets. We apply two deep learning pipelines, one for human activity recognition and one for heart rate estimation. HAR is achieved through the application of a visual classification approach, capable of robust performance at low sample rates. Here, transfer learning is leveraged to retrain a convolutional neural network (CNN) to distinguish characteristics of the PPG during different human activities. For heart rate estimation we use a CNN adopted for regression which maps noisy optical signals to heart rate estimates. In both cases, comparisons are made with leading conventional approaches. Our results demonstrate a low sampling frequency can achieve good performance without significant degradation of accuracy. 5 Hz and 10 Hz were shown to have 80.2% and 83.0% classification accuracy for HAR respectively. These same sampling frequencies also yielded a robust heart rate estimation which was comparative with that achieved at the more energy-intensive rate of 256 Hz.

PPGnet: Deep Network for Device Independent Heart Rate Estimation from Photoplethysmogram

Deep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks

CorNET: Deep Learning Framework for PPG-Based Heart Rate Estimation and Biometric Identification in Ambulant Environment

Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices

Supervised Heart Rate Tracking using Wrist-Type Photoplethysmographic (PPG) Signals during Physical Exercise without Simultaneous Acceleration Signals

Embedding Temporal Convolutional Networks for Energy-efficient PPG-based Heart Rate Monitoring

PPG2ECGps: An End-to-End Subject-Specific Deep Neural Network Model for Electrocardiogram Reconstruction from Photoplethysmography Signals without Pulse Arrival Time Adjustments

KID-PPG: Knowledge Informed Deep Learning for Extracting Heart Rate from a Smartwatch

Deep Learning Fused Wearable Pressure and PPG Data for Accurate Heart Rate Monitoring

Deep-HR: Fast Heart Rate Estimation from Face Video under Realistic Conditions

Assessment of Non-Invasive Blood Pressure Prediction from PPG and rPPG Signals Using Deep Learning

PPG-Based Smart Wearable Device With Energy-Efficient Computing for Mobile Health-Care Applications

On-Device Reliability Assessment and Prediction of Missing Photoplethysmographic Data Using Deep Neural Networks

PPG-based Heart Rate Estimation with Efficient Sensor Sampling and Learning Models

Multi-Head Cross-Attentional PPG and Motion Signal Fusion for Heart Rate Estimation

DSE-NN: Deeply Supervised Efficient Neural Network for Real-Time Remote Photoplethysmography

Quality Assessment of Photoplethysmography Signals For Cardiovascular Biomarkers Monitoring Using Wearable Devices

A Feasibility Study of a Video-Based Heart Rate Estimation Method with Convolutional Neural Networks

Optimised Convolutional Neural Networks for Heart Rate Estimation and Human Activity Recognition in Wrist Worn Sensing Applications

Recognising Cardiac Abnormalities in Wearable Device Photoplethysmography (PPG) with Deep Learning

Non-invasive cuff free blood pressure and heart rate measurement from photoplethysmography (PPG) signal using machine learning