Abstract:Background The continuous monitoring and recording of patients’ pain status is a major problem in current research on postoperative pain management. In the large number of original or review articles focusing on different approaches for pain assessment, many researchers have investigated how computer vision (CV) can help by capturing facial expressions. However, there is a lack of proper comparison of results between studies to identify current research gaps. Objective The purpose of this systematic review and meta-analysis was to investigate the diagnostic performance of artificial intelligence models for multilevel pain assessment from facial images. Methods The PubMed, Embase, IEEE, Web of Science, and Cochrane Library databases were searched for related publications before September 30, 2023. Studies that used facial images alone to estimate multiple pain values were included in the systematic review. A study quality assessment was conducted using the Quality Assessment of Diagnostic Accuracy Studies, 2nd edition tool. The performance of these studies was assessed by metrics including sensitivity, specificity, log diagnostic odds ratio (LDOR), and area under the curve (AUC). The intermodal variability was assessed and presented by forest plots. Results A total of 45 reports were included in the systematic review. The reported test accuracies ranged from 0.27-0.99, and the other metrics, including the mean standard error (MSE), mean absolute error (MAE), intraclass correlation coefficient (ICC), and Pearson correlation coefficient (PCC), ranged from 0.31-4.61, 0.24-2.8, 0.19-0.83, and 0.48-0.92, respectively. In total, 6 studies were included in the meta-analysis. Their combined sensitivity was 98% (95% CI 96%-99%), specificity was 98% (95% CI 97%-99%), LDOR was 7.99 (95% CI 6.73-9.31), and AUC was 0.99 (95% CI 0.99-1). The subgroup analysis showed that the diagnostic performance was acceptable, although imbalanced data were still emphasized as a major problem. All studies had at least one domain with a high risk of bias, and for 20% (9/45) of studies, there were no applicability concerns. Conclusions This review summarizes recent evidence in automatic multilevel pain estimation from facial expressions and compared the test accuracy of results in a meta-analysis. Promising performance for pain estimation from facial images was established by current CV algorithms. Weaknesses in current studies were also identified, suggesting that larger databases and metrics evaluating multiclass classification performance could improve future studies. Trial Registration PROSPERO CRD42023418181; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=418181

Pain Recognition Model classified neonatal pain with 98% accuracy

Using sensor-fusion and machine-learning algorithms to assess acute pain in non-verbal infants: a study protocol

Comparative analysis of artificial intelligence and expert assessments in detecting neonatal procedural pain

Accurate Neonatal Face Detection for Improved Pain Classification in the Challenging NICU Setting

Performance Evaluation of a Supervised Machine Learning Pain Classification Model Developed by Neonatal Nurses

Attentional Generative Multimodal Network for Neonatal Postoperative Pain Estimation

Artificial Intelligence Based Pain Assessment Technology in Clinical Application of Real-World Neonatal Blood Sampling

Neonatal procedural pain can be assessed by computer software that has good sensitivity and specificity to detect facial movements

Video-Based Versus On-Site Neonatal Pain Assessment in Neonatal Intensive Care Units: the Impact of Video-Based Neonatal Pain Assessment in Real-World Scenario on Pain Diagnosis and Its Artificial Intelligence Application.

Developing and Validating a Multimodal Dataset for Neonatal Pain Assessment to Improve AI Algorithms With Clinical Data

Human vs machine towards neonatal pain assessment: A comprehensive analysis of the facial features extracted by health professionals, parents, and convolutional neural networks

Application of AI in Multilevel Pain Assessment Using Facial Images: Systematic Review and Meta-Analysis

Continuous visualization and validation of pain in critically ill patients using artificial intelligence: a retrospective observational study

Health Care Professionals' and Parents' Perspectives on the Use of AI for Pain Monitoring in the Neonatal Intensive Care Unit: Multisite Qualitative Study

Deep Learning-Based Pain Classifier Based on the Facial Expression in Critically Ill Patients

Multi-Channel Neural Network for Assessing Neonatal Pain from Videos

Development of a binary classifier model from extended facial codes toward video-based pain recognition in cancer patients

Pain Analysis, in Premature Infants, Using Near Infrared Spectroscopy (NIRS)

Machine-based Multimodal Pain Assessment Tool for Infants: A Review

Calibration trial of an innovative medical device (NEVVA© ) for the evaluation of pain in non-communicating patients in the intensive care unit

Facial Action Unit Detection on ICU Data for Pain Assessment