Abstract:Background: Neonatal pain assessment (NPA) represents a huge global problem of essential importance, as a timely and accurate assessment of neonatal pain is indispensable for implementing pain management. Purpose: To investigate the consistency of pain scores derived through video-based NPA (VB-NPA) and on-site NPA (OS-NPA), providing the scientific foundation and feasibility of adopting VB-NPA results in a real-world scenario as the gold standard for neonatal pain in clinical studies and labels for artificial intelligence (AI)-based NPA (AI-NPA) applications. Setting: A total of 598 neonates were recruited from a pediatric hospital in China. Methods: This observational study recorded 598 neonates who underwent one of 10 painful procedures, including arterial blood sampling, heel blood sampling, fingertip blood sampling, intravenous injection, subcutaneous injection, peripheral intravenous cannulation, nasopharyngeal suctioning, retention enema, adhesive removal, and wound dressing. Two experienced nurses performed OS-NPA and VB-NPA at a 10-day interval through double-blind scoring using the Neonatal Infant Pain Scale to evaluate the pain level of the neonates. Intra-rater and inter-rater reliability were calculated and analyzed, and a paired samples t-test was used to explore the bias and consistency of the assessors’ pain scores derived through OS-NPA and VB-NPA. The impact of different label sources was evaluated using three state-of-the-art AI methods trained with labels given by OS-NPA and VB-NPA, respectively. Results: The intra-rater reliability of the same assessor was 0.976–0.983 across different times, as measured by the intraclass correlation coefficient. The inter-rater reliability was 0.983 for single measures and 0.992 for average measures. No significant differences were observed between the OS-NPA scores and the assessment of an independent VB-NPA assessor. The different label sources only caused a limited accuracy loss of 0.022–0.044 for the three AI methods. Conclusion: VB-NPA in a real-world scenario is an effective way to assess neonatal pain due to its high intra-rater and inter-rater reliability compared to OS-NPA and could be used for the labeling of large-scale NPA video databases for clinical studies and AI training.

Performance Evaluation of a Supervised Machine Learning Pain Classification Model Developed by Neonatal Nurses

Using sensor-fusion and machine-learning algorithms to assess acute pain in non-verbal infants: a study protocol

Pain Recognition Model classified neonatal pain with 98% accuracy

Accurate Neonatal Face Detection for Improved Pain Classification in the Challenging NICU Setting

Human vs machine towards neonatal pain assessment: A comprehensive analysis of the facial features extracted by health professionals, parents, and convolutional neural networks

Developing and Validating a Multimodal Dataset for Neonatal Pain Assessment to Improve AI Algorithms With Clinical Data

Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessment

Machine-based Multimodal Pain Assessment Tool for Infants: A Review

Video-Based Versus On-Site Neonatal Pain Assessment in Neonatal Intensive Care Units: the Impact of Video-Based Neonatal Pain Assessment in Real-World Scenario on Pain Diagnosis and Its Artificial Intelligence Application.

Attentional Generative Multimodal Network for Neonatal Postoperative Pain Estimation

Pain Analysis, in Premature Infants, Using Near Infrared Spectroscopy (NIRS)

Harnessing the Power of Deep Learning Methods in Healthcare: Neonatal Pain Assessment from Crying Sound

Understanding Risk Factors for Postoperative Mortality in Neonates Based on Explainable Machine Learning Technology

Comparative analysis of artificial intelligence and expert assessments in detecting neonatal procedural pain

Video-Based Neonatal Pain Assessment in Uncontrolled Conditions.

Artificial Intelligence Based Pain Assessment Technology in Clinical Application of Real-World Neonatal Blood Sampling

Multi-Channel Neural Network for Assessing Neonatal Pain from Videos

Health Care Professionals' and Parents' Perspectives on the Use of AI for Pain Monitoring in the Neonatal Intensive Care Unit: Multisite Qualitative Study

1616 Pain Evaluation in Preterm Infants using Skin Conductance Algesimeter

Automated Discomfort Detection for Premature Infants in NICU Using Time-Frequency Feature-Images and CNNs

Prediction of neonatal death in pregnant women in an intensive care unit: Application of machine learning models