Abstract:Traditional pain assessment approaches ranging from self-reporting methods, to observational scales, rely on the ability of an individual to accurately assess and successfully report observed or experienced pain episodes. Automatic pain assessment tools are therefore more than desirable in cases where this specific ability is negatively affected by various psycho-physiological dispositions, as well as distinct physical traits such as in the case of professional athletes, who usually have a higher pain tolerance as regular individuals. Hence, several approaches have been proposed during the past decades for the implementation of an autonomous and effective pain assessment system. These approaches range from more conventional supervised and semi-supervised learning techniques applied on a set of carefully hand-designed feature representations, to deep neural networks applied on preprocessed signals. Some of the most prominent advantages of deep neural networks are the ability to automatically learn relevant features, as well as the inherent adaptability of trained deep neural networks to related inference tasks. Yet, some significant drawbacks such as requiring large amounts of data to train deep models and over-fitting remain. Both of these problems are especially relevant in pain intensity assessment, where labeled data is scarce and generalization is of utmost importance. In the following work we address these shortcomings by introducing several novel multi-modal deep learning approaches (characterized by specific supervised, as well as self-supervised learning techniques) for the assessment of pain intensity based on measurable bio-physiological data. While the proposed supervised deep learning approach is able to attain state-of-the-art inference performances, our self-supervised approach is able to significantly improve the data efficiency of the proposed architecture by automatically generating physiological data and simultaneously performing a fine-tuning of the architecture, which has been previously trained on a significantly smaller amount of data.

A novel approach for pain intensity detection based on facial feature deformations

Pain assessment from facial expression images utilizing Statistical Frei-Chen Mask (SFCM)-based features and DenseNet

Pain Analysis using Adaptive Hierarchical Spatiotemporal Dynamic Imaging

Fusing Deep Learned and Hand-Crafted Features of Appearance, Shape, and Dynamics for Automatic Pain Estimation

Multi-Modal Pain Intensity Assessment Based on Physiological Signals: A Deep Learning Perspective

Logistic Regression Based Model for Pain Intensity Level Detection from Biomedical Signal

Automatic detection of pain intensity

A Video Database of Neonatal Facial Expression Based on Painful Clinical Procedures

Development of a binary classifier model from extended facial codes toward video-based pain recognition in cancer patients

Incorporating High-Level and Low-Level Cues for Pain Intensity Estimation

Automatic Estimation of Self-Reported Pain by Interpretable Representations of Motion Dynamics

Automatic Estimation of Self-Reported Pain by Trajectory Analysis in the Manifold of Fixed Rank Positive Semi-Definite Matrices

DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain

Personalized Federated Deep Learning for Pain Estimation From Face Images

Pain Intensity Estimation by a Self--Taught Selection of Histograms of Topographical Features

Pain Intensity Estimation from Mobile Video Using 2D and 3D Facial Keypoints

A Deep Attention Transformer Network for Pain Estimation with Facial Expression Video

Self-supervised pain intensity estimation from facial videos via statistical spatiotemporal distillation

Personalized Deep Bi-LSTM RNN Based Model for Pain Intensity Classification Using EDA Signal

A Spatiotemporal Convolutional Neural Network for Automatic Pain Intensity Estimation from Facial Dynamics

On Pain Assessment from Facial Videos Using Spatio-Temporal Local Descriptors