Abstract:The shapes of speakers’ vocal organs change under their different emotional states, which leads to the deviation of the emotional acoustic space of short-time features from the neutral acoustic space and thereby the degradation of the speaker recognition performance. Features deviating greatly from the neutral acoustic space are considered as mismatched features, and they negatively affect speaker recognition systems. Emotion variation produces different feature deformations for different phonemes, so it is reasonable to build a finer model to detect mismatched features under each phoneme. However, given the difficulty of phoneme recognition, three sorts of acoustic class recognition—phoneme classes, Gaussian mixture model（GMM） tokenizer, and probabilistic GMM tokenizer—are proposed to replace phoneme recognition. We propose feature pruning and feature regulation methods to process the mismatched features to improve speaker recognition performance. As for the feature regulation method, a strategy of maximizing the between-class distance and minimizing the within-class distance is adopted to train the transformation matrix to regulate the mismatched features. Experiments conducted on the Mandarin affective speech corpus（MASC） show that our feature pruning and feature regulation methods increase the identification rate（IR） by 3.64% and 6.77%, compared with the baseline GMM-UBM（universal background model） algorithm. Also, corresponding IR increases of 2.09% and 3.32% can be obtained with our methods when applied to the state-of-the-art algorithm i-vector.

Robust Recognition of Mandarin Vowels by Articulatory Manners

Mfcc And Svm Based Recognition Of Chinese Vowels

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Pronunciation recognition of English phonemes /\textipa{@}/, /æ/, /\textipa{A}:/ and /\textipa{2}/ using Formants and Mel Frequency Cepstral Coefficients

Vowel Creation by Articulatory Control in HMM-based Parametric Speech Synthesis

An Emotional Text-Driven 3D Visual Pronunciation System for Mandarin Chinese

An Anti-noise Algorithm for Speaker-Dependent Mandarin Vocal Numbers Recognition

Articulation constrained learning with application to speech emotion recognition

Robust Audio-Visual Mandarin Speech Recognition Based on Adaptive Decision Fusion and Tone Features

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

Mandarin accent identification based on GMM with multi-feature fusion

Practice of the conformer enhanced AUDIO-VISUAL HUBERT on Mandarin and English

Mismatched Feature Detection with Finer Granularity for Emotional Speaker Recognition.

Robust Speech Recognition Based on MVDR and CCBC Approach

Integrating Articulatory Features into Acoustic-Phonemic Model for Mispronunciation Detection and Diagnosis in L2 English Speech.

An Efficient Approach to Chinese Phoneme Mouth-Shape Recognition

Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition

Unvoiced Speech Recognition Algorithm Based on Myoelectric Signal