Abstract:Emotion recognition realizing human inner perception has a very important application prospect in human-computer interaction. In order to improve the accuracy of emotion recognition, a novel method combining fused nonlinear features and team-collaboration identification strategy was proposed for emotion recognition using physiological signals. Four nonlinear features, namely approximate entropy (ApEn), sample entropy (SaEn), fuzzy entropy (FuEn) and wavelet packet entropy (WpEn) are employed to reflect emotional states deeply with each type of physiological signal. Then the features of different physiological signals are fused to represent the emotional states from multiple perspectives. Each classifier has its own advantages and disadvantages. In order to make full use of the advantages of other classifiers and avoid the limitation of single classifier, the team-collaboration model is built and the team-collaboration decision-making mechanism is designed according to the proposed team-collaboration identification strategy which is based on the fusion of support vector machine (SVM), decision tree (DT) and extreme learning machine (ELM). Through analysis, SVM is selected as the main classifier with DT and ELM as auxiliary classifiers. According to the designed decision-making mechanism, the proposed team-collaboration identification strategy can effectively employ different classification methods to make decision based on the characteristics of the samples through SVM classification. For samples which are easy to be identified by SVM, SVM directly determines the identification results, whereas SVM-DT-ELM collaboratively determines the identification results, which can effectively utilize the characteristics of each classifier and improve the classification accuracy. The effectiveness and universality of the proposed method are verified by Augsburg database and database for emotion analysis using physiological (DEAP) signals. The experimental results uniformly indicated that the proposed method combining fused nonlinear features and team-collaboration identification strategy presents better performance than the existing methods.

User Emotion Recognition Based on Multidimensional Data Feature Fusion

Emotion Recognition in Videos via Fusing Multimodal Features.

Multimodal Emotion Recognition Based on Feature Fusion.

A snapshot research and implementation of multimodal information fusion for data-driven emotion recognition

Enhancing emotion recognition using multimodal fusion of physiological, environmental, personal data

Emotion Recognition Model Based on Multimodal Decision Fusion

MoodExplorer

An Improved Multimodal Dimension Emotion Recognition Based on Different Fusion Methods

Behavioral and Physiological Signals-Based Deep Multimodal Approach for Mobile Emotion Recognition

Emotional State Recognition from Peripheral Physiological Signals Using Fused Nonlinear Features and Team-Collaboration Identification Strategy

Multimodal Emotion Recognition based on the Fusion of EEG Signals and Eye Movement Data

Feature-level fusion of multimodal physiological signals for emotion recognition

Multimodal Emotion Recognition From EEG Signals and Facial Expressions

Multimodal Emotion Recognition Based on Cascaded Multichannel and Hierarchical Fusion

Wearable Biosensor Network Enabled Multimodal Daily-Life Emotion Recognition Employing Reputation-Driven Imbalanced Fuzzy Classification

End-to-End Multimodal Emotion Recognition Based on Facial Expressions and Remote Photoplethysmography Signals

Research And Application Analysis of Multimodal Emotion Recognition Methods Based on Speech, Text, And Facial Expressions

Research on Emotional Interaction and User Cognition

Multimodal Emotion Recognition Based on Facial Expressions, Speech, and Body Gestures

Multimodal Emotion Recognition based on Facial Expressions, Speech, and EEG

Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals