Abstract:Traditional pain assessment approaches ranging from self-reporting methods, to observational scales, rely on the ability of an individual to accurately assess and successfully report observed or experienced pain episodes. Automatic pain assessment tools are therefore more than desirable in cases where this specific ability is negatively affected by various psycho-physiological dispositions, as well as distinct physical traits such as in the case of professional athletes, who usually have a higher pain tolerance as regular individuals. Hence, several approaches have been proposed during the past decades for the implementation of an autonomous and effective pain assessment system. These approaches range from more conventional supervised and semi-supervised learning techniques applied on a set of carefully hand-designed feature representations, to deep neural networks applied on preprocessed signals. Some of the most prominent advantages of deep neural networks are the ability to automatically learn relevant features, as well as the inherent adaptability of trained deep neural networks to related inference tasks. Yet, some significant drawbacks such as requiring large amounts of data to train deep models and over-fitting remain. Both of these problems are especially relevant in pain intensity assessment, where labeled data is scarce and generalization is of utmost importance. In the following work we address these shortcomings by introducing several novel multi-modal deep learning approaches (characterized by specific supervised, as well as self-supervised learning techniques) for the assessment of pain intensity based on measurable bio-physiological data. While the proposed supervised deep learning approach is able to attain state-of-the-art inference performances, our self-supervised approach is able to significantly improve the data efficiency of the proposed architecture by automatically generating physiological data and simultaneously performing a fine-tuning of the architecture, which has been previously trained on a significantly smaller amount of data.

Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video

Fusing Deep Learned and Hand-Crafted Features of Appearance, Shape, and Dynamics for Automatic Pain Estimation

Pain Analysis using Adaptive Hierarchical Spatiotemporal Dynamic Imaging

An Automatic System for Continuous Pain Intensity Monitoring Based on Analyzing Data from Uni-, Bi-, and Multi-Modality

Non-contact Pain Recognition from Video Sequences with Remote Physiological Measurements Prediction

Multi-Channel Neural Network for Assessing Neonatal Pain from Videos

Two-Stream Attention Network for Pain Recognition from Video Sequences

Automatic Estimation of Self-Reported Pain by Interpretable Representations of Motion Dynamics

Automated Electrodermal Activity and Facial Expression Analysis for Continuous Pain Intensity Monitoring on the X-ITE Pain Database

Saliency Supervision: An Intuitive and Effective Approach for Pain Intensity Regression

Automatic Pain Estimation from Facial Expressions: A Comparative Analysis Using Off-the-Shelf CNN Architectures

Personalized Deep Bi-LSTM RNN Based Model for Pain Intensity Classification Using EDA Signal

How Much Does It Hurt: A Deep Learning Framework for Chronic Pain Score Assessment

Hybrid RNN-ANN Based Deep Physiological Network for Pain Recognition

Pain level and pain-related behaviour classification using GRU-based sparsely-connected RNNs

Deep Weakly-Supervised Domain Adaptation for Pain Localization in Videos

Self-supervised pain intensity estimation from facial videos via statistical spatiotemporal distillation

Multi-Modal Pain Intensity Assessment Based on Physiological Signals: A Deep Learning Perspective

Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals

Automatic Estimation of Self-Reported Pain by Trajectory Analysis in the Manifold of Fixed Rank Positive Semi-Definite Matrices

Video-Based Neonatal Pain Assessment in Uncontrolled Conditions.