Abstract:Emotion recognition realizing human inner perception has a very important application prospect in human-computer interaction. In order to improve the accuracy of emotion recognition, a novel method combining fused nonlinear features and team-collaboration identification strategy was proposed for emotion recognition using physiological signals. Four nonlinear features, namely approximate entropy (ApEn), sample entropy (SaEn), fuzzy entropy (FuEn) and wavelet packet entropy (WpEn) are employed to reflect emotional states deeply with each type of physiological signal. Then the features of different physiological signals are fused to represent the emotional states from multiple perspectives. Each classifier has its own advantages and disadvantages. In order to make full use of the advantages of other classifiers and avoid the limitation of single classifier, the team-collaboration model is built and the team-collaboration decision-making mechanism is designed according to the proposed team-collaboration identification strategy which is based on the fusion of support vector machine (SVM), decision tree (DT) and extreme learning machine (ELM). Through analysis, SVM is selected as the main classifier with DT and ELM as auxiliary classifiers. According to the designed decision-making mechanism, the proposed team-collaboration identification strategy can effectively employ different classification methods to make decision based on the characteristics of the samples through SVM classification. For samples which are easy to be identified by SVM, SVM directly determines the identification results, whereas SVM-DT-ELM collaboratively determines the identification results, which can effectively utilize the characteristics of each classifier and improve the classification accuracy. The effectiveness and universality of the proposed method are verified by Augsburg database and database for emotion analysis using physiological (DEAP) signals. The experimental results uniformly indicated that the proposed method combining fused nonlinear features and team-collaboration identification strategy presents better performance than the existing methods.

Ensemble Emotion Recognizing with Multiple Modal Physiological Signals

Emotion recognition based on multiple physiological signals

A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

Emotion Recognition Based on the Multiple Physiological Signals

Recognition of Emotions Using Multimodal Physiological Signals and an Ensemble Deep Learning Model

Multimodal Emotion Recognition by Combining Physiological Signals and Facial Expressions: a Preliminary Study.

Valence-Arousal Model based Emotion Recognition using EEG, peripheral physiological signals and Facial Expression

Emotion Recognition Based on a Limited Number of Multimodal Physiological Signals Channels

Emotion Recognition from Multiple Physiological Signals Using Intra- and Inter-Modality Attention Fusion Network

Multimodal Emotion Recognition Model using Physiological Signals

Emotion Recognition Using the Fusion of Frontal 2-channel EEG Signals and Peripheral Physiological Signals.

Multi-physiological signal emotion recognition algorithm based on improved Relief F

Joint low-rank tensor fusion and cross-modal attention for multimodal physiological signals based emotion recognition

Development of Multi-modal Physiological Signals Acquisition Platform and Its Application in Emotional Recognition Based on a Small Number of Samples

Emotional State Recognition from Peripheral Physiological Signals Using Fused Nonlinear Features and Team-Collaboration Identification Strategy

Feature-level fusion of multimodal physiological signals for emotion recognition

Multimodal Physiological Signal Emotion Recognition Based on Convolutional Recurrent Neural Network

Human Emotion Classification Based on Multiple Physiological Signals by Wearable System.

Emotion Recognition From Multimodal Physiological Signals Using a Regularized Deep Fusion of Kernel Machine

Multimodal Emotion Recognition From EEG Signals and Facial Expressions

Hybrid deep convolutional model-based emotion recognition using multiple physiological signals