Nonlinear Signal Processing Methods for Automatic Emotion Recognition Using Electrodermal Activity
Yedukondala Rao Veeranki,Luis Roberto Mercado Diaz,Ramakrishnan Swaminathan,Hugo F. Posada-Quintero
DOI: https://doi.org/10.1109/jsen.2024.3354553
IF: 4.3
2024-03-15
IEEE Sensors Journal
Abstract:Detection of emotional states plays a prominent role in affective computing, decision-making, and healthcare. Physiological signals are an ideal target for continuous and objective assessment of emotional states. Electrodermal activity (EDA) is considered one of the most effective and widely used markers of sympathetic activation. However, emotional state assessment using EDA is challenging. We hypothesize that this is caused by the impossibility of current EDA analysis tools to capture the nonlinear variations of the signal. Selecting an appropriate nonlinear signal processing method will allow more effective emotion recognition using EDA signals. In this study, we have compared the performance of four nonlinear signal processing methods—improved symbolic aggregate approximation (isaxEDA), complexity analysis (comEDA), topological analysis (topEDA), and network theory-based analysis (netEDA)—for classifying emotional states using EDA signals. For this, EDA signals were obtained from the publicly available continuously annotated signals of emotion (CASE) dataset. Features are extracted from each of the nonlinear signal processing methods, encompassing aspects related to the dynamics, complexity, structure, and network properties of EDA. Subsequently, the extracted features from each method were employed as input for four machine learning classifiers: naïve Bayes, random forest, -nearest neighbors, and support vector machine, which were validated using leave-one-subject-out cross validation. The results demonstrate that isaxEDA achieved the highest performance, with an F1-score of 65% using an SVM classifier. The study supports the suitability of nonlinear EDA signal processing to improve emotion recognition, which could be used to detect mental health conditions such as anxiety and depression.
engineering, electrical & electronic,instruments & instrumentation,physics, applied