Abstract:Speech is the most important tool for human to express thoughts and emotion, as well as it is an important part of human culture. Speech affective recognition（SAR）, as an important task in affective computing, has become an international research hotspot and attracts more and more attention. Neuroscience research has shown that the brain is the material basis for producing and regulating emotions. Therefore, in the study of speech emotion, we should not only consider the speech signal itself, but also integrate the activity signal of the brain into speech affective recognition to achieve a higher accuracy rate. Based on the above ideas, a speech feature projection method based on Kernel Canonical Correlation Analysis（KCCA）was proposed in this paper. This method maps speech and electroencephalogram（EEG）features to a high-dimensional Hilbert space and calculates the maximum correlation coefficient between them. KCCA projects the speech features in the direction with the greatest correlation with the EEG features, and finally obtains the speech features containing EEG information. This method incorporates EEG information related to speech emotion into speech emotion feature extraction, which can more accurately represent emotion. At the same time, this method has good migration in theory. When the proposed EEG features are sufficiently accurate and representative, the projection vectors obtained from KCCA modeling are generalizable and can be used directly in new speech emotion datasets without reacquisition and computation of the responding EEG. The experimental results on MSP-IMPROV and self-built speech emotion datasets show that the projected speech feature is better than the original speech feature and other speech feature extraction methods.

Spontaneous Speech Emotion Recognition Via Multiple Kernel Learning

Speaker-Independent Speech Emotion Recognition Based On Two-Layer Multiple Kernel Learning

MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Natural-Emotion Gmm Transformation Algorithm For Emotional Speaker Recognition

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

A Feature Selection And Feature Fusion Combination Method For Speaker-Independent Speech Emotion Recognition

Speech Emotion Recognition based on Optimized Support Vector Machine.

Visual-Audio Emotion Recognition Based on Multi-Task and Ensemble Learning with Multiple Features

Spontaneous Speech Emotion Recognition Using Multiscale Deep Convolutional LSTM

Multi-feature Fusion Speech Emotion Recognition Based on SVM

Deep Learning and SVM-based Emotion Recognition from Chinese Speech for Smart Affective Services

A Novel Dual Kernel Support Vector-Based Levy Dung Beetle Algorithm for Accurate Speech Emotion Detection

Facial Expression Recognition Based on Multiple Kernel Learning

Speech Emotion Recognition Based on SVM and GMM-HMM Hybrid System

Efficient Speech Emotion Recognition Based on Multisurface Proximal Support Vector Machine

A Study of Speech Emotion Recognition Based on Hybrid Algorithm

A Comparison of Machine Learning Algorithms and Feature Sets for Automatic Vocal Emotion Recognition in Speech

Speech Emotion Recognition Using Multiple Classifiers

Speaker Independent Emotion Recognition Based on SVM/HMMS Fusion System

Speech Emotion Recognition Through Kernel Canonical Correlation Analysis