Abstract:Introduction Objective pain assessment in non-verbal populations is clinically challenging due to their inability to express their pain via self-report. Repetitive exposures to acute or prolonged pain lead to clinical instability, with long-term behavioural and cognitive sequelae in newborn infants. Strong analgesics are also associated with medical complications, potential neurotoxicity and altered brain development. Pain scores performed by bedside nurses provide subjective, observer-dependent assessments rather than objective data for infant pain management; the required observations are labour intensive, difficult to perform by a nurse who is concurrently performing the procedure and increase the nursing workload. Multimodal pain assessment, using sensor-fusion and machine-learning algorithms, can provide a patient-centred, context-dependent, observer-independent and objective pain measure. Methods and analysis In newborns undergoing painful procedures, we use facial electromyography to record facial muscle activity-related infant pain, ECG to examine heart rate (HR) changes and HR variability, electrodermal activity (skin conductance) to measure catecholamine-induced palmar sweating, changes in oxygen saturations and skin perfusion, and electroencephalography using active electrodes to assess brain activity in real time. This multimodal approach has the potential to improve the accuracy of pain assessment in non-verbal infants and may even allow continuous pain monitoring at the bedside. The feasibility of this approach will be evaluated in an observational prospective study of clinically required painful procedures in 60 preterm and term newborns, and infants aged 6 months or less. Ethics and dissemination The Institutional Review Board of the Stanford University approved the protocol. Study findings will be published in peer-reviewed journals, presented at scientific meetings, taught via webinars, podcasts and video tutorials, and listed on academic/scientific websites. Future studies will validate and refine this approach using the minimum number of sensors required to assess neonatal/infant pain. Trial registration number ClinicalTrials.gov Registry ( NCT03330496 ).

Video-based Discomfort Detection for Infants.

Automatic and Continuous Discomfort Detection for Premature Infants in a NICU Using Video-Based Motion Analysis

Detecting Discomfort in Infants Through Facial Expressions

Automated Discomfort Detection for Premature Infants in NICU Using Time-Frequency Feature-Images and CNNs

Using sensor-fusion and machine-learning algorithms to assess acute pain in non-verbal infants: a study protocol

Inherent Emotional Feature Extraction of Neonatal Cry

Video-Based Neonatal Pain Assessment in Uncontrolled Conditions.

Accurate Neonatal Face Detection for Improved Pain Classification in the Challenging NICU Setting

Automatic cry analysis and classification for infant pain assessment

A Video Database of Neonatal Facial Expression Based on Painful Clinical Procedures

Towards early prediction of neurodevelopmental disorders: Computational model for Face Touch and Self-adaptors in Infants

Subtle Signals: Video-based Detection of Infant Non-nutritive Sucking as a Neurodevelopmental Cue

Automatic Smile Detection of Infants in Mother-Infant Interaction Via CNN-based Feature Learning

Automatic Neonatal Alertness State Classification Based on Facial Expression Recognition

ARL-IL CNN for Automatic Facial Expression Recognition of Infants under 24 Months of Age

Deep Convolution Network Based Emotion Analysis for Automatic Detection of Mild Cognitive Impairment in the Elderly

Automated Prediction of Infant Cognitive Development Risk by Video: A Pilot Study

Neonatal Face and Facial Landmark Detection from Video Recordings

Multimodality Video Acquisition System for the Assessment of Vital Distress in Children

Multi-Channel Neural Network for Assessing Neonatal Pain from Videos

A Multi-center Clinical Trial for Camera-based Infant Sleep and Awake Detection in Neonatal Intensive Care Unit