Abstract:Precise monitoring of respiratory rate in premature newborn infants is essential to initiating medical interventions as required. Wired technologies can be invasive and obtrusive to the patients. We propose a deep-learning-enabled wearable monitoring system for premature newborn infants, where respiratory cessation is predicted using signals that are collected wirelessly from a non-invasive wearable Bellypatch put on the infant’s body. We propose a five-stage design pipeline involving data collection and labeling, feature scaling, deep learning model selection with hyperparameter tuning, model training and validation, and model testing and deployment. The model used is a 1-D convolutional neural network (1DCNN) architecture with one convolution layer, one pooling layer, and three fully-connected layers, achieving 97.15% classification accuracy. To address the energy limitations of wearable processing, several quantization techniques are explored, and their performance and energy consumption are analyzed for the respiratory classification task. Results demonstrate a reduction of energy footprints and model storage overhead with a considerable degradation of the classification accuracy, meaning that quantization and other model compression techniques are not the best solution for respiratory classification problem on wearable devices. To improve accuracy while reducing the energy consumption, we propose a novel spiking neural network (SNN)-based respiratory classification solution, which can be implemented on event-driven neuromorphic hardware platforms. To this end, we propose an approach to convert the analog operations of our baseline trained 1DCNN to their spiking equivalent. We perform a design-space exploration using the parameters of the converted SNN to generate inference solutions having different accuracy and energy footprints. We select a solution that achieves an accuracy of 93.33% with 18x lower energy compared to the baseline 1DCNN model. Additionally, the proposed SNN solution achieves similar accuracy as the quantized model with a 4× lower energy.

Comparison of end-to-end neural network architectures and data augmentation methods for automatic infant motility assessment using wearable sensors

Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensors

Enhanced Infant Movement Analysis Using Transformer-Based Fusion of Diverse Video Features For Neurodevelopmental Monitoring

Evaluation of self-supervised pre-training for automatic infant movement classification using wearable movement sensors

Deep learning empowered sensor fusion boosts infant movement classification

Intelligence Sparse Sensor Network for Automatic Early Evaluation of General Movements in Infants

Intelligent wearable allows out-of-the-lab tracking of developing motor abilities in infants

Infant movement classification through pressure distribution analysis

Predicting Infant Motor Development Status using Day Long Movement Data from Wearable Sensors

Energy-Efficient Respiratory Anomaly Detection in Premature Newborn Infants

Deep-learning for automated markerless tracking of infants general movements

Towards human-level performance on automatic pose estimation of infant spontaneous movements

Automatic assessment of infant carrying and holding using at-home wearable recordings

A Spatio-temporal Attention-based Model for Infant Movement Assessment from Videos

2D Capsule Networks Detect Perceived Changes in Infant∼Environment Relationship Reflected in 3D Movement Dynamics

Identifying Infant Body Position from Inertial Sensors with Machine Learning: Which Parameters Matter?

Automated Classification of General Movements in Infants Using a Two-stream Spatiotemporal Fusion Network

Towards early prediction of neurodevelopmental disorders: Computational model for Face Touch and Self-adaptors in Infants

Video-Based Automatic Baby Motion Analysis for Early Neurological Disorder Diagnosis: State of the Art and Future Directions

Machine learning approaches to evaluate infants' general movements in the writhing stage—a pilot study

Little Motion, Big Results: Using Motion Magnification to Reveal Subtle Tremors in Infants