Abstract:The shapes of speakers’ vocal organs change under their different emotional states, which leads to the deviation of the emotional acoustic space of short-time features from the neutral acoustic space and thereby the degradation of the speaker recognition performance. Features deviating greatly from the neutral acoustic space are considered as mismatched features, and they negatively affect speaker recognition systems. Emotion variation produces different feature deformations for different phonemes, so it is reasonable to build a finer model to detect mismatched features under each phoneme. However, given the difficulty of phoneme recognition, three sorts of acoustic class recognition—phoneme classes, Gaussian mixture model（GMM） tokenizer, and probabilistic GMM tokenizer—are proposed to replace phoneme recognition. We propose feature pruning and feature regulation methods to process the mismatched features to improve speaker recognition performance. As for the feature regulation method, a strategy of maximizing the between-class distance and minimizing the within-class distance is adopted to train the transformation matrix to regulate the mismatched features. Experiments conducted on the Mandarin affective speech corpus（MASC） show that our feature pruning and feature regulation methods increase the identification rate（IR） by 3.64% and 6.77%, compared with the baseline GMM-UBM（universal background model） algorithm. Also, corresponding IR increases of 2.09% and 3.32% can be obtained with our methods when applied to the state-of-the-art algorithm i-vector.

Research on Speaker Classification Method Based on Acoustic Merging Feature

Speaker Classification Algorithm Based on Spatial Acoustic Feature

A Novel Discriminant Locality Preserving Projections for MDM-based Speaker Classification

A Spatial Long-Term Iterative Mask Estimation Approach for Multi-Channel Speaker Diarization and Speech Recognition.

Speaker clustering method for distributed microphone

Dereverberation for Speaker Identification in Meeting

Mismatched Feature Detection with Finer Granularity for Emotional Speaker Recognition.

A Speaker-Dependent Approach to Separation of Far-Field Multi-Talker Microphone Array Speech for Front-End Processing in the CHiME-5 Challenge

Speaker Recognition Based on Pre-Trained Model and Deep Clustering

Unified Modeling of Multi-Talker Overlapped Speech Recognition and Diarization with a Sidecar Separator

A Speaker-Dependent Approach to Single-Channel Joint Speech Separation and Acoustic Modeling Based on Deep Neural Networks for Robust Recognition of Multi-Talker Speech

Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization

A Speaker-Dependent Deep Learning Approach to Joint Speech Separation and Acoustic Modeling for Multi-Talker Automatic Speech Recognition

A Quick and Effective Speaker Diarization System.

Multi-speaker Segmentation and Clustering of Telephone Speech

A Real-time Speaker Diarization System Based on Spatial Spectrum

Exploring Speaker-Related Information in Spoken Language Understanding for Better Speaker Diarization

Speaker Discrimination on Broadcast News and Telephonic Calls Using a Fusion of Neural and Statistical Classifiers

Multi-feature Combination for Speaker Recognition

Investigation of acoustic and visual features for acoustic scene classification

A new DP-like speaker clustering algorithm