Abstract:Background One of the most critical issues in human-computer interaction applications is recognizing human emotions based on speech. In recent years, the challenging problem of cross-corpus speech emotion recognition（SER） has generated extensive research. Nevertheless, the domain discrepancy between training data and testing data remains a major challenge to achieving improved system performance. Methods network for conducting multiple timescales domain adaptation for cross-corpus SER, i. e., integrating domain discriminators of hierarchical levels into the emotion recognition framework to mitigate the gap between the source and target domains. Specifically, we extract two kinds of speech features, i.e., handcraft features and deep features, from three timescales of global, local, and hybrid levels. In each timescale, the domain discriminator and the feature extrator compete against each other to learn features that minimize the discrepancy between the two domains by fooling the discriminator. Results Extensive experiments on cross-corpus and cross-language SER were conducted on a combination dataset that combines one Chinese dataset and two English datasets commonly used in SER. The MSDA is affected by the strong discriminate power provided by the adversarial process, where three discriminators are working in tandem with an emotion classifier. Accordingly, the MSDA achieves the best performance over all other baseline methods. Conclusions The proposed architecture was tested on a combination of one Chinese and two English datasets. The experimental results demonstrate the superiority of our powerful discriminative model for solving cross-corpus SER.

Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG)

Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG)

Cross-Culture Multimodal Emotion Recognition With Adversarial Learning

Adversarial Domain Generalized Transformer for Cross-Corpus Speech Emotion Recognition

Self Supervised Adversarial Domain Adaptation for Cross-Corpus and Cross-Language Speech Emotion Recognition

Transferable Positive/negative Speech Emotion Recognition Via Class-wise Adversarial Domain Adaptation

Multi-scale Discrepancy Adversarial Network for Crosscorpus Speech Emotion Recognition

Improving Speech Emotion Recognition With Adversarial Data Augmentation Network

Learning Representations of Emotional Speech with Deep Convolutional Generative Adversarial Networks

A cross-corpus study on speech emotion recognition

A Generalized Subspace Distribution Adaptation Framework for Cross-Corpus Speech Emotion Recognition

Cross-Corpus Speech Emotion Recognition Based on Hybrid Neural Networks

Domain adversarial learning for emotion recognition

Unsupervised Cross-Lingual Speech Emotion Recognition Using DomainAdversarial Neural Network

A study on cross-corpus speech emotion recognition and data augmentation

Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Recognition

Unsupervised Cross-Corpus Speech Emotion Recognition Using Domain-Adaptive Subspace Learning

Cross-Corpus Speech Emotion Recognition Using Joint Distribution Adaptive Regression

Towards Conditional Adversarial Training for Predicting Emotions from Speech

Towards Adversarial Learning of Speaker-Invariant Representation for Speech Emotion Recognition