Abstract:Cross-corpus speech emotion recognition (SER) poses a challenge due to feature distribution mismatch, potentially degrading the performance of established SER methods. In this paper, we tackle this challenge by proposing a novel transfer subspace learning method called acoustic knowledgeguided transfer linear regression (AKTLR). Unlike existing approaches, which often overlook domain-specific knowledge related to SER and simply treat cross-corpus SER as a generic transfer learning task, our AKTLR method is built upon a well-designed acoustic knowledge-guided dual sparsity constraint mechanism. This mechanism emphasizes the potential of minimalistic acoustic parameter feature sets to alleviate classifier overadaptation, which is empirically validated acoustic knowledge in SER, enabling superior generalization in cross-corpus SER tasks compared to using large feature sets. Through this mechanism, we extend a simple transfer linear regression model to AKTLR. This extension harnesses its full capability to seek emotiondiscriminative and corpus-invariant features from established acoustic parameter feature sets used for describing speech signals across two scales: contributive acoustic parameter groups and constituent elements within each contributive group. Our proposed method is evaluated through extensive cross-corpus SER experiments on three widely-used speech emotion corpora: EmoDB, eNTERFACE, and CASIA. The results confirm the effectiveness and superior performance of our method, outperforming recent state-of-the-art transfer subspace learning and deep transfer learning-based cross-corpus SER methods. Furthermore, our work provides experimental evidence supporting the feasibility and superiority of incorporating domain-specific knowledge into the transfer learning model to address cross-corpus SER tasks.

Speech Emotion Recognition Based On Sparse Transfer Learning Method

Self-attention Transfer Networks for Speech Emotion Recognition

Cost-Sensitive Learning for Emotion Robust Speaker Recognition

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Cross-corpus Speech Emotion Recognition Based on Joint Transfer Subspace Learning and Regression

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Nonnegative Matrix Factorization Based Transfer Subspace Learning for Cross-Corpus Speech Emotion Recognition

Speech Emotion Recognition Based on Meta-Transfer Learning with Domain Adaption

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

Transfer EEG Emotion Recognition by Combining Semi-Supervised Regression with Bipartite Graph Label Propagation

Spontaneous Speech Emotion Recognition Using Multiscale Deep Convolutional LSTM

Speech Emotion Recognition Based on Convolutional Neural Network with Attention-Based Bidirectional Long Short-Term Memory Network and Multi-Task Learning

Latent sparse transfer subspace learning for cross-corpus facial expression recognition

Speech Emotion Recognition Based on Formant Characteristics Feature Extraction and Phoneme Type Convergence.

Towards Domain-Specific Cross-Corpus Speech Emotion Recognition Approach

Speech emotion recognition based on multi-dimensional feature extraction and multi-scale feature fusion

Transfer Subspace Learning for Unsupervised Cross-Corpus Speech Emotion Recognition

Self-labeling with feature transfer for speech emotion recognition

Learning Transferable Sparse Representations for Cross-corpus Facial Expression Recognition