Abstract:Precise monitoring of respiratory rate in premature newborn infants is essential to initiating medical interventions as required. Wired technologies can be invasive and obtrusive to the patients. We propose a deep-learning-enabled wearable monitoring system for premature newborn infants, where respiratory cessation is predicted using signals that are collected wirelessly from a non-invasive wearable Bellypatch put on the infant’s body. We propose a five-stage design pipeline involving data collection and labeling, feature scaling, deep learning model selection with hyperparameter tuning, model training and validation, and model testing and deployment. The model used is a 1-D convolutional neural network (1DCNN) architecture with one convolution layer, one pooling layer, and three fully-connected layers, achieving 97.15% classification accuracy. To address the energy limitations of wearable processing, several quantization techniques are explored, and their performance and energy consumption are analyzed for the respiratory classification task. Results demonstrate a reduction of energy footprints and model storage overhead with a considerable degradation of the classification accuracy, meaning that quantization and other model compression techniques are not the best solution for respiratory classification problem on wearable devices. To improve accuracy while reducing the energy consumption, we propose a novel spiking neural network (SNN)-based respiratory classification solution, which can be implemented on event-driven neuromorphic hardware platforms. To this end, we propose an approach to convert the analog operations of our baseline trained 1DCNN to their spiking equivalent. We perform a design-space exploration using the parameters of the converted SNN to generate inference solutions having different accuracy and energy footprints. We select a solution that achieves an accuracy of 93.33% with 18x lower energy compared to the baseline 1DCNN model. Additionally, the proposed SNN solution achieves similar accuracy as the quantized model with a 4× lower energy.

A Neonatal Dataset and Benchmark for Non-Contact Neonatal Heart Rate Monitoring Based on Spatio-Temporal Neural Networks

Deep learning based non-contact physiological monitoring in Neonatal Intensive Care Unit

Camera-based heart rate estimation for hospitalized newborns in the presence of motion artifacts

Non-Contact Heart Rate Monitoring In Neonatal Intensive Care Unit Using Rgb Camera

Camera-based Cardiorespiratory Monitoring of Preterm Infants in NICU

Deep-HR: Fast Heart Rate Estimation from Face Video under Realistic Conditions

Camera-Based Remote Photoplethysmography for Physiological Monitoring in Neonatal Intensive Care

Continuous non-contact vital sign monitoring of neonates in intensive care units using RGB-D cameras

Camera-based Monitoring of Heart Rate Variability for Preterm Infants in Neonatal Intensive Care Unit

Real-Time Multi-Level Neonatal Heart and Lung Sound Quality Assessment for Telehealth Applications

Remote Heart Rate Measurement from Face Videos under Realistic Situations

Non-contact respiratory rate monitoring using thermal and visible imaging: a pilot study on neonates

Automatic Infant Respiration Estimation from Video: A Deep Flow-based Algorithm and a Novel Public Benchmark

Heart Rate Estimation From Facial Videos Using a Spatiotemporal Representation With Convolutional Neural Networks

Fast body part segmentation and tracking of neonatal video data using deep learning

Sensor Fusion for the Robust Detection of Facial Regions of Neonates Using Neural Networks

RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation

Energy-Efficient Respiratory Anomaly Detection in Premature Newborn Infants

A Deep Learning-Based Brain Age Prediction Model for Preterm Infants Via Neonatal MRI

Neonatal Face and Facial Landmark Detection from Video Recordings

A Large-Scale Clinical Benchmark of ResNet-based Deep Models for Newborn Face Recognition