Abstract:Emotion recognition realizing human inner perception has a very important application prospect in human-computer interaction. In order to improve the accuracy of emotion recognition, a novel method combining fused nonlinear features and team-collaboration identification strategy was proposed for emotion recognition using physiological signals. Four nonlinear features, namely approximate entropy (ApEn), sample entropy (SaEn), fuzzy entropy (FuEn) and wavelet packet entropy (WpEn) are employed to reflect emotional states deeply with each type of physiological signal. Then the features of different physiological signals are fused to represent the emotional states from multiple perspectives. Each classifier has its own advantages and disadvantages. In order to make full use of the advantages of other classifiers and avoid the limitation of single classifier, the team-collaboration model is built and the team-collaboration decision-making mechanism is designed according to the proposed team-collaboration identification strategy which is based on the fusion of support vector machine (SVM), decision tree (DT) and extreme learning machine (ELM). Through analysis, SVM is selected as the main classifier with DT and ELM as auxiliary classifiers. According to the designed decision-making mechanism, the proposed team-collaboration identification strategy can effectively employ different classification methods to make decision based on the characteristics of the samples through SVM classification. For samples which are easy to be identified by SVM, SVM directly determines the identification results, whereas SVM-DT-ELM collaboratively determines the identification results, which can effectively utilize the characteristics of each classifier and improve the classification accuracy. The effectiveness and universality of the proposed method are verified by Augsburg database and database for emotion analysis using physiological (DEAP) signals. The experimental results uniformly indicated that the proposed method combining fused nonlinear features and team-collaboration identification strategy presents better performance than the existing methods.

WT Feature Based Emotion Recognition from Multi-channel Physiological Signals with Decision Fusion

Emotion Recognition in Videos via Fusing Multimodal Features.

Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals

Emotion Recognition Based on the Multiple Physiological Signals

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Feature-level fusion of multimodal physiological signals for emotion recognition

Emotion Classification with Multichannel Physiological Signals Using Hybrid Feature and Adaptive Decision Fusion

Emotion Recognition From Multimodal Physiological Signals Using a Regularized Deep Fusion of Kernel Machine

Joint low-rank tensor fusion and cross-modal attention for multimodal physiological signals based emotion recognition

Emotion Recognition Using the Fusion of Frontal 2-channel EEG Signals and Peripheral Physiological Signals.

Multimodal emotion recognition using EEG and eye tracking data.

Emotion Recognition from Multiple Physiological Signals Using Intra- and Inter-Modality Attention Fusion Network

Multimodal Recognition of Emotions Using Physiological Signals with the Method of Decision-Level Fusion for Healthcare Applications

Emotion recognition based on multiple physiological signals

EEG-Based Emotion Recognition Fusing Spacial-Frequency Domain Features and Data-Driven Spectrogram-Like Features.

Decision Fusion for EEG-based Emotion Recognition

Emotion Assessment Using Feature Fusion and Decision Fusion Classification Based on Physiological Data: Are We There Yet?

Emotion Recognition and Channel Selection Based on EEG Signal

Emotional State Recognition from Peripheral Physiological Signals Using Fused Nonlinear Features and Team-Collaboration Identification Strategy

Combining feature-level and decision-level fusion in a hierarchical classifier for emotion recognition in the wild

Hierarchical fusion of visual and physiological signals for emotion recognition