Abstract:Cross-corpus speech emotion recognition (SER) is a challenging task, and its difficulty lies in the mismatch between the feature distributions of the training (source domain) and testing (target domain) data, leading to the performance degradation when the model deals with new domain data. Previous works explore utilizing domain adaptation (DA) to eliminate the domain shift between the source and target domains and have achieved the promising performance in SER. However, these methods mainly treat cross-corpus tasks simply as the DA problem, directly aligning the distributions across domains in a common feature space. In this case, excessively narrowing the domain distance will impair the emotion discrimination of speech features since it is difficult to maintain the completeness of the emotion space only by an emotion classifier. To overcome this issue, we propose a progressively discriminative transfer network (PDTN) for cross-corpus SER in this paper, which can enhance the emotion discrimination ability of speech features while eliminating the mismatch between the source and target corpora. In detail, we design two special losses in the feature layers of PDTN, i.e., emotion discriminant loss Ld and distribution alignment loss La. By incorporating prior knowledge of speech emotion into feature learning (i.e., high and low valence speech emotion features have their respective cluster centers), we integrate a valence-aware center loss Lv and an emotion-aware center loss Lc as the Ld to guarantee the discriminative learning of speech emotions except an emotion classifier. Furthermore, a multi-layer distribution alignment loss La is adopted to more precisely eliminate the discrepancy of feature distributions between the source and target domains. Finally, through the optimization of PDTN by combining three losses, i.e., cross-entropy loss Le, Ld, and La, we can gradually eliminate the domain mismatch between the source and target corpora while maintaining the emotion discrimination of speech features. Extensive experimental results of six cross-corpus tasks on three datasets, i.e., Emo-DB, eNTERFACE, and CASIA, reveal that our proposed PDTN outperforms the state-of-the-art methods.

PEFT-SER: On the Use of Parameter Efficient Transfer Learning Approaches For Speech Emotion Recognition Using Pre-trained Speech Models

Parameter Efficient Finetuning for Speech Emotion Recognition and Domain Adaptation

TrustSER: On the Trustworthiness of Fine-tuning Pre-trained Speech Embeddings For Speech Emotion Recognition

Active Learning Based Fine-Tuning Framework for Speech Emotion Recognition

Improving Pre-trained Model-based Speech Emotion Recognition from a Low-level Speech Feature Perspective

Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition

Speech Emotion Recognition Based on Formant Characteristics Feature Extraction and Phoneme Type Convergence.

Fast Yet Effective Speech Emotion Recognition with Self-distillation

Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognition

Speech Emotion Recognition Based on Meta-Transfer Learning with Domain Adaption

LanSER: Language-Model Supported Speech Emotion Recognition

PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques

Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentation

Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment

When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods

Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translation

A Comparative Study of Pre-trained Speech and Audio Embeddings for Speech Emotion Recognition

Progressively Discriminative Transfer Network for Cross-Corpus Speech Emotion Recognition

Less Could Be Better: Parameter-efficient Fine-tuning Advances Medical Vision Foundation Models

Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications