Abstract:The shapes of speakers’ vocal organs change under their different emotional states, which leads to the deviation of the emotional acoustic space of short-time features from the neutral acoustic space and thereby the degradation of the speaker recognition performance. Features deviating greatly from the neutral acoustic space are considered as mismatched features, and they negatively affect speaker recognition systems. Emotion variation produces different feature deformations for different phonemes, so it is reasonable to build a finer model to detect mismatched features under each phoneme. However, given the difficulty of phoneme recognition, three sorts of acoustic class recognition—phoneme classes, Gaussian mixture model（GMM） tokenizer, and probabilistic GMM tokenizer—are proposed to replace phoneme recognition. We propose feature pruning and feature regulation methods to process the mismatched features to improve speaker recognition performance. As for the feature regulation method, a strategy of maximizing the between-class distance and minimizing the within-class distance is adopted to train the transformation matrix to regulate the mismatched features. Experiments conducted on the Mandarin affective speech corpus（MASC） show that our feature pruning and feature regulation methods increase the identification rate（IR） by 3.64% and 6.77%, compared with the baseline GMM-UBM（universal background model） algorithm. Also, corresponding IR increases of 2.09% and 3.32% can be obtained with our methods when applied to the state-of-the-art algorithm i-vector.

Mandarin accent identification based on GMM with multi-feature fusion

Reliable accent specific unit generation with dynamic Gaussian mixture selection for multi-accent speech recognition

Combining prosodic and spectral features for Mandarin intonation recognition

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Using Cepstral and Prosodic Features for Chinese Accent Identification

Reliable Accent-Specific Unit Generation With Discriminative Dynamic Gaussian Mixture Selection for Multi-Accent Chinese Speech Recognition

Feature selection of mime speech recognition using surface electromyography data

Discriminative Dynamic Gaussian Mixture Selection with Enhanced Robustness and Performance for Multi-Accent Speech Recognition

Investigation of Deep Neural Network Acoustic Modelling Approaches for Low Resource Accented Mandarin Speech Recognition

High Performance Digit Mandarin Speech Recognition

Detection-based accented speech recognition using articulatory features.

Improved Accent Classification Combining Phonetic Vowels with Acoustic Features

Combining Mfcc And Pitch To Enhance The Performance Of The Gender Recognition

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

Mandarin-English bilingual phone modeling and combining MPE based Discriminative training for cross-language speech recognition

Real Context Model for Tone Recognition in Mandarin Conversational Telephone Speech

Mismatched Feature Detection with Finer Granularity for Emotional Speaker Recognition.

TONE RECOGNITION OF CHINESE CONTINUOUS SPEECH

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Local Mismatch Phone for Confidence Measure in Standard and Accented Chinese Speech Recognition