Abstract:The shapes of speakers’ vocal organs change under their different emotional states, which leads to the deviation of the emotional acoustic space of short-time features from the neutral acoustic space and thereby the degradation of the speaker recognition performance. Features deviating greatly from the neutral acoustic space are considered as mismatched features, and they negatively affect speaker recognition systems. Emotion variation produces different feature deformations for different phonemes, so it is reasonable to build a finer model to detect mismatched features under each phoneme. However, given the difficulty of phoneme recognition, three sorts of acoustic class recognition—phoneme classes, Gaussian mixture model（GMM） tokenizer, and probabilistic GMM tokenizer—are proposed to replace phoneme recognition. We propose feature pruning and feature regulation methods to process the mismatched features to improve speaker recognition performance. As for the feature regulation method, a strategy of maximizing the between-class distance and minimizing the within-class distance is adopted to train the transformation matrix to regulate the mismatched features. Experiments conducted on the Mandarin affective speech corpus（MASC） show that our feature pruning and feature regulation methods increase the identification rate（IR） by 3.64% and 6.77%, compared with the baseline GMM-UBM（universal background model） algorithm. Also, corresponding IR increases of 2.09% and 3.32% can be obtained with our methods when applied to the state-of-the-art algorithm i-vector.

Research on the Robust Speaker Identification Based on Adaptive Frequency Warping

Research on Bandwidth Mismatch Compensation in Speech Recognition

Auditory model-based speech feature extraction and its application to speaker identification

An Auditory Feature Extraction Method Based on Forward-Masking and Its Application in Robust Speaker Identification and Speech Recognition.

Reference Point Alignment Frequency Warpmethod For Speaker Adaptation

Design and implementation of speech recognition algorithm based on frequency range

Reference Point Alignment Frequency Warp Method for Speaker Adaptation

Wavelet-Based Mel-Frequency Cepstral Coefficients for Speaker Identification using Hidden Markov Models

Daubechies Wavelets Based Robust Audio Fingerprinting for Content-Based Audio Retrieval

Robust Speech Recognition Based on Spectral Adjusting and Warping

Modified MFCCs for Robust Speaker Recognition

A Forward Masking Auditory Model And Its Application In Speaker Identification And Speech Recognition

Text-independent Speaker Identification Based on Spectral Weighting Functions

Mismatched Feature Detection with Finer Granularity for Emotional Speaker Recognition.

Auditory Model Based Speech Feature Extraction and Its Application to Speaker Identification

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

Noise Robust Speaker Recognition Based on Adaptive Frame Weighting in GMM for i-Vector Extraction.

Robust Speech Recognition by Selecting Mel-Filter Banks

Distortionless Multi-Channel Target Speech Enhancement for Overlapped Speech Recognition

Improvement on Automatic Speech Segmentation Using Wavelet Packet Transform Features

Application of a New Mixed Feature in Speaker Identification