Abstract:Speaker verification suffers from significant performance degradation with emotion variation. In a previous study, we have demonstrated that an adaptation approach based on MLLR/CMLLR can provide a significant performance improvement for verification on emotional speech. This paper follows this direction and presents an emotional adaptive training (EAT) approach. This approach iteratively estimates the emotion-dependent CMLLR transformations and re-trains the speaker models with the transformed speech, which therefore can make use of emotional enrollment speech to train a stronger speaker model. This is similar to the speaker adaptive training (SAT) in speech recognition. The experiments are conducted on an emotional speech database which involves speech recordings of 30 speakers in 5 emotions. The results demonstrate that the EAT approach provides significant performance improvements over the baseline system where the neutral enrollment data are used to train the speaker models and the emotional test utterances are verified directly. The EAT also outperforms another two emotionadaptation approaches in a significant way: (1) the CMLLR-based approach where the speaker models are trained with the neutral enrollment speech and the emotional test utterances are transformed by CMLLR in verification; (2) the MAP-based approach where the emotional enrollment data are used to train emotion-dependent speaker models and the emotional utterances are verified based on the emotion-matched models.

Study on Speaker Verification on Emotional Speech

Scores Selection for Emotional Speaker Recognition

Emotional Speaker Identification By Humans And Machines

Reliability detection by Fuzzy SVM with UBM Component feature for emotional speaker recognition

Toward emotional speaker recognition: framework and preliminary results

Natural-Emotion Gmm Transformation Algorithm For Emotional Speaker Recognition

A Preliminary Study on GMM Weight Transformation for Emotional Speaker Recognition

Emotional Speech Clustering Based Robust Speaker Recognition System

Learning Virtual HD Model for Bi-model Emotional Speaker Recognition

Learning Polynomial Function Based Neutral-Emotion Gmm Transformation For Emotional Speaker Recognition

Applying Emotional Factor Analysis And I-Vector To Emotional Speaker Recognition

Emotional speaker recognition based on similar neighbor phenomenon

Emotional Speaker Recognition Based on Model Space Migration through Translated Learning.

Emotion-State conversion for speaker recognition

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Emotional speaker recognition based on i-vector through Atom Aligned Sparse Representation

Cost-Sensitive Learning for Emotion Robust Speaker Recognition

Applying difference detection and pruning to emotional speaker recognition

Affect-Insensitive Speaker Recognition by Feature Variety Training

Emotion Attribute Projection For Speaker Recognition On Emotional Speech

Emotional adaptive training for speaker verification