Automated facial recognition system using deep learning for pain assessment in adults with cerebral palsy

Álvaro Sabater-Gárriz,F. Xavier Gaya-Morey,José María Buades-Rubio,Cristina Manresa Yee,Pedro Montoya,Inmaculada Riquelme

2024-01-23

Abstract:Background: Pain assessment in individuals with neurological conditions, especially those with limited self-report ability and altered facial expressions, presents challenges. Existing measures, relying on direct observation by caregivers, lack sensitivity and specificity. In cerebral palsy, pain is a common comorbidity and a reliable evaluation protocol is crucial. Thus, having an automatic system that recognizes facial expressions could be of enormous help when diagnosing pain in this type of patient.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address the challenge of assessing facial pain expressions in patients with cerebral palsy (CP). Specifically, the research has two main objectives: 1. **Construct a Pain Expression Dataset**: Create a facial pain expression dataset for cerebral palsy patients (CPPAIN), which includes 109 preprocessed facial pain expression images classified by two physical therapists based on the Facial Action Coding System (FACS). 2. **Develop an Automated Facial Recognition System**: Develop an automated facial recognition system based on deep learning technology to assess the pain levels of cerebral palsy patients. By training multiple neural network models and testing them on various pain image databases, the goal is to improve the accuracy and reliability of pain assessment. ### Research Background and Significance - **Background**: Pain assessment is highly challenging for individuals with neurological disorders, especially those with limited self-reporting abilities and abnormal facial expressions. Existing assessment methods rely on direct observation by caregivers, but these methods lack sensitivity and specificity. In cerebral palsy patients, pain is a common complication, and reliable assessment protocols are crucial. - **Objective**: To identify facial expressions through an automated facial recognition system, thereby aiding in the diagnosis of pain in such patients. The research also utilizes Explainable Artificial Intelligence (XAI) technology to reveal the key features of different models in pain recognition, further enhancing the system's credibility and accuracy. - **Innovation**: The study creates a facial pain expression dataset specifically for cerebral palsy patients and demonstrates the potential of deep learning models in pain detection for individuals with neurological disorders and communication impairments. By expanding the dataset specific to cerebral palsy, the accuracy of the models can be further improved, providing valuable tools for identifying subtle and unique pain expressions. The research findings can also be extended to other complex neurological disorders.

Automated facial recognition system using deep learning for pain assessment in adults with cerebral palsy

Using sensor-fusion and machine-learning algorithms to assess acute pain in non-verbal infants: a study protocol

Pain detection through facial expressions in children with autism using deep learning

Pain assessment from facial expression images utilizing Statistical Frei-Chen Mask (SFCM)-based features and DenseNet

Automatic Infants' Pain Assessment by Dynamic Facial Representation: Effects of Profile View, Gestational Age, Gender, and Race.

Automated Assessment of Pain: Prospects, Progress, and a Path Forward

Automatic Recognition Methods Supporting Pain Assessment: A Survey

Pain assessment in horses using automatic facial expression recognition through deep learning-based modeling

Human vs machine towards neonatal pain assessment: A comprehensive analysis of the facial features extracted by health professionals, parents, and convolutional neural networks

Development of a binary classifier model from extended facial codes toward video-based pain recognition in cancer patients

Automated Electrodermal Activity and Facial Expression Analysis for Continuous Pain Intensity Monitoring on the X-ITE Pain Database

Facial Action Unit Detection on ICU Data for Pain Assessment

Assessing the Efficacy of Deep Learning Approaches for Facial Expression Recognition in Individuals with Intellectual Disabilities

Accurate Neonatal Face Detection for Improved Pain Classification in the Challenging NICU Setting

Fusing Deep Learned and Hand-Crafted Features of Appearance, Shape, and Dynamics for Automatic Pain Estimation

Deep Learning for the Assessment of Facial Nerve Palsy: Opportunities and Challenges

Deep Learning Assessment Method for Postoperative Pain Based on Facial Video Data

Toward an Automatic System for Computer-Aided Assessment in Facial Palsy

Deep Learning-Based Pain Classifier Based on the Facial Expression in Critically Ill Patients

Automatic detection of pain intensity

Unobtrusive Pain Monitoring in Older Adults With Dementia Using Pairwise and Contrastive Training