Abstract:Speech is the most important tool for human to express thoughts and emotion, as well as it is an important part of human culture. Speech affective recognition（SAR）, as an important task in affective computing, has become an international research hotspot and attracts more and more attention. Neuroscience research has shown that the brain is the material basis for producing and regulating emotions. Therefore, in the study of speech emotion, we should not only consider the speech signal itself, but also integrate the activity signal of the brain into speech affective recognition to achieve a higher accuracy rate. Based on the above ideas, a speech feature projection method based on Kernel Canonical Correlation Analysis（KCCA）was proposed in this paper. This method maps speech and electroencephalogram（EEG）features to a high-dimensional Hilbert space and calculates the maximum correlation coefficient between them. KCCA projects the speech features in the direction with the greatest correlation with the EEG features, and finally obtains the speech features containing EEG information. This method incorporates EEG information related to speech emotion into speech emotion feature extraction, which can more accurately represent emotion. At the same time, this method has good migration in theory. When the proposed EEG features are sufficiently accurate and representative, the projection vectors obtained from KCCA modeling are generalizable and can be used directly in new speech emotion datasets without reacquisition and computation of the responding EEG. The experimental results on MSP-IMPROV and self-built speech emotion datasets show that the projected speech feature is better than the original speech feature and other speech feature extraction methods.

Speech Emotion Recognition Based on Kernel Reduced-Rank Regression

Emotional Speech Clustering Based Robust Speaker Recognition System

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Speech Emotion Recognition Using an Enhanced Kernel Isomap for Human-Robot Interaction

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Speaker-independent Speech Emotion Recognition Based on Random Forest Feature Selection Algorithm

Speech Emotion Recognition Through Kernel Canonical Correlation Analysis

Relative entropy normalized Gaussian supervector for speech emotion recognition using kernel extreme learning machine.

Kernel Low-Rank Representation for Face Recognition.

Speech Emotion Recognition based on Optimized Support Vector Machine.

Emotion Recognition From Arbitrary View Facial Images

Spatial-Temporal Recurrent Neural Network for Emotion Recognition

How Speech is Recognized to Be Emotional - A Study Based on Information Decomposition

Recognizing Sentence Emotions Based On Polynomial Kernel Method Using Ren-Cecps

Emotion-Detecting Based Model Selection For Emotional Speech Recognition

Low-rank kernel regression with preserved locality for multi-class analysis

A Data Driven Emotion Recognition Method Based on Rough Set Theory

Facial Expression Recognition Via Kernel Sparse Representation

Sentence Emotion Analysis and Recognition Based on Emotion Words Using Ren-CECps ∗

Comparing Feature Dimension Reduction Algorithms for GMM-SVM Based Speech Emotion Recognition