Combining Speech Enhancement and Discriminative Feature Extraction for Robust Speaker Recognition

Yan Zhang,Zhenmin Tang,Yanping Li

DOI: https://doi.org/10.1109/CSIE.2009.61

2009-01-01

Abstract:In this work, we are developing the computer aided composition system. This system aids a person, which knows cellphone or background music of home page or software. This system is implemented with the interactive selective population climbing. We suppose ...

What problem does this paper attempt to address?

Design and implementation of a speaker recognition system

韩雁,陈利华

DOI: https://doi.org/10.3785/j.issn.1008-973X.2001.02.011

2001-01-01

Abstract:After a various of comparison among possible speech processingapproaches, we present and developed a speaker recognition system(SRS). The six Chinese single vowels are selected as the test elements of our models. The computer speech analysis techniques adopted in this system include short-time power and short-time average zero-cross rate test, cepstrum analysis and linear prediction coding, which are used to detect the start-end points of speech and to get the characteristic parameters of the speaker. This system is implemented under MATLAB and Windows environment and has perfect recognition results.
Multi-feature Combination for Speaker Recognition

Zhiyi Li,Liang He,Wei-Qiang Zhang,Jia Liu

DOI: https://doi.org/10.1109/iscslp.2010.5684885

2010-01-01

Abstract:Combination of different features has been proved to be a good method for improving performance in speech recognition. In speaker recognition (SRE), various features have also been developed to reflect complementary aspects of speaker's characteristics. This paper proposed an effective multi-feature combination in speaker recognition. In order to avoid the “dimensionality disaster” and to delimit the redundant information, linear discriminant analysis (LDA) is used to reduce the high dimensionality of combined feature to be lower. Then feature-domain channel compensation is applied to improve the performance. In experiments, we use the popular short-term spectral Mel-frequency cepstral coefficients (MFCC) and novel spectro-temporal time-frequency cepstrum (TFC) to do feature combination followed by LDA and feature-domain latent factor analysis (fLFA) for channel compensation respectively. The experimental results on the NIST SRE2008 short2 telephone-short3 telephone test set show that the proposed multi-feature combination is an effective method to outperform both raw features.
Combining Speech Enhancement with Feature Post-processing for Robust Speech Recognition

Jianjun Lei,Jun Guo,Gang Liu,Jian Wang,Xiangfei Nie,Zhen Yang

DOI: https://doi.org/10.1007/978-3-540-37258-5_90

2006-01-01

Abstract:In this paper, we present an effective scheme combining speech enhancement with feature post-processing to improve the robustness of speech recognition systems. At front-end, minimum mean square error log-spectral amplitude (MMSE-LSA) speech enhancement is adopted to suppress noise from noisy speech. Nevertheless this enhancement is not perfect and the enhanced speech retains signal distortion and residual noise which will affect the performance of recognition systems. Thus, at back-end, the MVA feature post-processing is used to deal with the remaining mismatch between enhanced speech and clean speech. We have evaluated recognition performance under noisy environments using NOISEX-92 database and recorded speech signals in continuous speech recognition task. Experimental results show that our approach exhibits considerable improvements in the degraded environment.
Multi-resolution Time Frequency Feature and Complementary Combination for Short Utterance Speaker Recognition

Zhi-Yi Li,Wei-Qiang Zhang,Jia Liu

DOI: https://doi.org/10.1007/s11042-013-1705-4

IF: 2.577

2013-01-01

Multimedia Tools and Applications

Abstract:A human speaker recognition expert often observes the speech spectrogram in multiple different scales for speaker recognition, especially under the short utterance condition. Inspired by this action, this paper proposes a novel multi-resolution time frequency feature (MRTF) extraction method, which is obtained by performing a 2-Dimensional discrete cosine transform (DCT) in multi-scale on the time frequency spectrogram matrix and then selecting and combining to the final multi-scaled transformed elements. Compared to the traditional Mel-Frequency Cepstral Coefficient (MFCC) feature extraction, the proposed method can make better use of multi-resolution temporal-frequency information. Beyond this, we also proposed three complementary combination strategies of MFCC and MRTF: in feature level, in i-vector level and in score level. Comparing their performance. We found the best results are obtained by combination in i-vector level. In the three NIST 2008 Speaker Recognition Evaluation datasets, the proposed method is the most effective for improving the performance under short utterance than under long utterance. And after the combination, we can achieve an EER of 11.32 % and MinDCF of 0.054 in the 10sec-10sec trials on the male dataset, which is an absolute 3 % improvement of EER than the best reported result in this field.
Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Jun-Wei Mao,Yong He,Zhen-Tao Liu

DOI: https://doi.org/10.23919/chicc.2018.8482931

2018-01-01

Abstract:For speech emotion recognition, emotional feature set with high dimension may produce redundant features and influence the recognition accuracy. To solve this problem and obtain the optimal emotional feature subset of speech, a feature dimension reduction based on linear discriminant analysis is proposed. According to the confusion degree between different basic emotions, an emotion recognition method based on support vector machine decision tree is proposed. Experiment on speaker-dependent speech emotion recognition using Chinese speech database from institute of automation of Chinese academy of sciences is performed and a speech emotion recognition system is presented, where standard feature sets of the INTER-SPEECH and classic classifiers are used in comparative experiments respectively. Experimental results show that the proposal achieves 84.39% recognition accuracy on average. By proposal, it would be fast and efficient to discriminate emotional states of diverse speakers from speech, and it would make it possible to realize the interaction between speaker and computer/robot in the future.
Further Feature Extraction and Its Application on Speaker Recognition

马志友,杨莹春,吴朝晖

DOI: https://doi.org/10.3969/j.issn.1007-0249.2003.02.029

2003-01-01

Abstract:The traditional feature extraction seems good to recognize speaker by their voice in small case. Nevertheless, the performance of recognizer is usually depressed by the limited feature space unable to cover the increasing number of speakers to be recognized. Accordingly, a novel feature extraction method is proposed, in which effective measures such as weight, differential, combination and selection, are taken to explore those voice characteristics that can be used to distinguish different speakers. Experiment based on 138-person YOHO database demonstrates that better performance can be achieved by the proposed method compared with traditional feature extraction methods.
Further Feature Extraction for Speaker Recognition

ZY Ma,YC Yang,ZH Wu

DOI: https://doi.org/10.1109/icsmc.2003.1245637

2003-01-01

Abstract:This thesis presents a method of extracting a new speaker's voice features for the purpose of synthetically using the voice of the donor speaker. In the small speaker set, it seems good to recognize speaker by their voice by means of the traditional feature extraction. Nevertheless, the performance of recognizer usually depressed owning to the limited feature space, it is hard to deal with the increasing of speaker set to be recognized Accordingly it proposes a novel feature extraction method, further feature extract (FFE), which is based on some measures such as weight, differential, combination and selection, are taken to explore those voice characteristics that can be used to distinguish different speakers. Experiment based on 138-person YOHO database demonstrates that better performance can be achieved by the proposed method.
A High-Performance Auditory Feature for Robust Speech Recognition

Qi Li,Frank K. Soong,Olivier Siohan

DOI: https://doi.org/10.21437/icslp.2000-475

2000-01-01

Abstract:An auditory feature extraction algorithm for robust speech recognition in adverse acoustic environments is proposed. Based on the analysis of human auditory system, the feature extraction algorithm consists of several modules: FFT, outer-middle-ear transfer function, frequency conversion from linear to Bark scales, auditory filtering, nonlinearity, and discrete cosine transform. Three recognition experiments have been conducted on connected digit recognition in wireless and land-line communications using handsets and handsfree microphones. Compared to LPCC and MFCC features, the proposed feature has shown 11% to 23% error-rate reductions on average in handset and hands-free acoustic environments in the experiments.
Robust Speaker Identification Using An Auditory-Based Feature

Qi Li,Yan Huang

DOI: https://doi.org/10.1109/ICASSP.2010.5495589

2010-01-01

Abstract:An auditory-based feature extraction algorithm is presented. The feature is based on a recently published time-frequency transform plus a set of modules to simulate the signal processing functions in the cochlea. The feature is applied to a speaker identification task to address the acoustic mismatch problem between training and testing. Usually, the performances of acoustic models trained in clean speech drop significantly when tested on noisy speech. The proposed feature has shown strong robustness in the mismatched situation. As shown in our experiments, in a speaker identification task, both MFCC and the proposed feature have near perfect performances in a clean testing condition, but when the SNR of input signal drops to 6 dB, the average accuracy of the MFCC feature is only 41.2%, while the proposed feature still achieves an average accuracy of 88.3%.
An Auditory System-Based Feature for Robust Speech Recognition.

Qi Li,Frank K. Soong,Olivier Siohan

DOI: https://doi.org/10.21437/eurospeech.2001-164

2001-01-01

Abstract:An auditory feature extraction algorithm for robust speech recognition in adverse acoustic environments is presented. The feature computation is comprised of an outer-middle-ear transfer function, FFT, frequency conversion from linear to the Bark scale, auditory filtering, nonlinearity, and discrete cosine transform. The feature is evaluated in two tasks: connected-digit recognition and large vocabulary continuous speech recognition. The tested data were under various noise conditions, including handset and hands-free speech data in landline and wireless communications with additive car and babble noise. Compared with the LPCC, MFCC, MELLPCC, and PLP features, the proposed feature has an average 20% to 30% string error rate reduction on the connected-digit task, and 8% to 14% word error rate reduction on the Wall Street Journal task in various additive noise conditions.
Combining Voiceprint and Face Biometrics for Speaker Identification Using SDWS.

Dongdong Li,Yingchun Yang,Zhaohui Wu

DOI: https://doi.org/10.21437/interspeech.2005-370

2005-01-01

Abstract:The biometric system that uses multiple biometric traits promises higher identification accuracy than identification in either individual domain. To reach this goal, special attention should be paid to the strategies for combining voiceprint and face experts. We propose an improved weighted sum rule based on the scores difference (SDWS) between the genuine speaker class and the mistaken speaker class labeled by each classifier, and demonstrate that the performance of multibiometric system can be further improved by SDWS. The tests were conducted on a multi-modal database with 54 users We compare our approach with other existing methods and show that SDWS improved performance by about 7.8-13.3%, much better than the others.
Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

K Chen,L Wang,HS Chi

DOI: https://doi.org/10.1142/s0218001497000196

IF: 1.261

1997-01-01

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:In practical applications of pattern recognition, there are often different features extracted from raw data which needs recognizing. Methods of combining multiple classifiers with different features are viewed as a general problem in various application areas of pattern recognition. In this paper, a systematic investigation has been made and possible solutions are classified into three frameworks, i.e. linear opinion pools, winner-take-all and evidential reasoning. For combining multiple classifiers with different features, a novel method is presented in the framework of linear opinion pools and a modified training algorithm for associative switch is also proposed in the framework of winner-take-all. In the framework of evidential reasoning, several typical methods are briefly reviewed for use. All aforementioned methods have already been applied to text-independent speaker identification. The simulations show that results yielded by the methods described in this paper are better than not only the individual classifiers' but also ones obtained by combining multiple classifiers with the same feature. It indicates that the use of combining multiple classifiers with different features is an effective way to attack the problem of text-independent speaker identification.
Fusion of Embeddings Networks for Robust Combination of Text Dependent and Independent Speaker Recognition

Ruirui Li,Chelsea J.-T. Ju,Zeya Chen,Hongda Mao,Oguz Elibol,Andreas Stolcke

DOI: https://doi.org/10.48550/arXiv.2106.10169

2021-06-18

Abstract:By implicitly recognizing a user based on his/her speech input, speaker identification enables many downstream applications, such as personalized system behavior and expedited shopping checkouts. Based on whether the speech content is constrained or not, both text-dependent (TD) and text-independent (TI) speaker recognition models may be used. We wish to combine the advantages of both types of models through an ensemble system to make more reliable predictions. However, any such combined approach has to be robust to incomplete inputs, i.e., when either TD or TI input is missing. As a solution we propose a fusion of embeddings network foenet architecture, combining joint learning with neural attention. We compare foenet with four competitive baseline methods on a dataset of voice assistant inputs, and show that it achieves higher accuracy than the baseline and score fusion methods, especially in the presence of incomplete inputs.

Machine Learning,Computation and Language,Sound,Audio and Speech Processing
Combining Mfcc And Pitch To Enhance The Performance Of The Gender Recognition

Huang Ting,Yang Yingchun,Wu Zhaohui

DOI: https://doi.org/10.1109/ICOSP.2006.345541

2006-01-01

Abstract:This paper describes a novel approach which combines the acoustic analysis using MFCC and the speaker's mean pitch to improve the performance of the gender recognition. In acoustic analysis, two sets of Gaussian Mixture Model(GMM), male and female, are trained from the speech, and the most likely sequence of models with corresponding likelihood scores are produced In pitch estimation approach, a threshold is specified to differentiate the two sets. The information provided by the acoustic analysis using MFCC and pitch estimation are combined by using a linear normalization fusion method. The system was tested on the SRMC databases giving at most 3.3% recognition error rate.
Speaker Recognition System in Multi-Channel Environment

LF Sang,ZH Wu,YC Yang

DOI: https://doi.org/10.1109/icsmc.2003.1244369

2003-01-01

Abstract:Expansions of mobile services and private data have required increased level of protection. Speaker recognition, one of the biometric technologies, arises lots of research interests for its simple, cheap and convenient characteristics. In this paper, a robust speaker recognition system which facilitates reliable authentication with multi-channel voices is presented. A large multi-channel corpus, including mobile phone, personal digital assistant (PDA), telephone and microphone, is collected to evaluate the system performance.
Language Recognition Based on Acoustic Diversified Phone Recognizers and Phonotactic Feature Fusion

Yan Deng,Wei-Qiang Zhang,Yan-Min Qian,Jia Liu

DOI: https://doi.org/10.1587/transinf.e94.d.679

2011-01-01

IEICE Transactions on Information and Systems

Abstract:One typical phonotactic system for language recognition is parallel phone recognition followed by vector space modeling (PPRVSM). In this system, various phone recognizers are applied in parallel and fused at the score level. Each phone recognizer is trained for a known language, which is assumed to extract complementary information for effective fusion. But this method is limited by the large amount of training samples for which word or phone level transcription is required. Also, score fusion is not the optimal method as fusion at the feature or model level will retain more information than at the score level. This paper presents a new strategy to build and fuse parallel phone recognizers (PPR). This is achieved by training multiple acoustic diversified phone recognizers and fusing at the feature level. The phone recognizers are trained on the same speech data but using different acoustic features and model training techniques. For the acoustic features, Mel-frequency cepstral coefficients (MFCC) and perceptual linear prediction (PLP) are both employed. In addition, a new time-frequency cepstrum (TFC) feature is proposed to extract complementary acoustic information. For the model training, we examine the use of the maximum likelihood and feature minimum phone error methods to train complementary acoustic models. In this study, we fuse phonotactic features of the acoustic diversified phone recognizers using a simple linear fusion method to build the PPRVSM system. A novel logistic regression optimized weighting (LROW) approach is introduced for fusion factor optimization. The experimental results show that fusion at the feature level is more effective than at the score level. And the proposed system is competitive with the traditional PPRVSM. Finally, the two systems are combined for further improvement. The best performing system reported in this paper achieves an equal error rate (EER) of 1.24%, 4.98% and 14.96% on the NIST 2007 LRE 30-second, 10-second and 3-second evaluation databases, respectively, for the closed-set test condition.
Robust Front-End for Speech Recognition Based on Computational Auditory Scene Analysis and Speaker Model

Yong Guan,Peng Li,Wenju Liu,Bo Xu

2009-01-01

Abstract:Conventional noise robust speech recognition system does not work well when human speech is presented in the background. In this paper, a computational auditory scene analysis (CASA) and speaker model based speech segregation system is proposed to solve this problem. By utilizing speaker model and factorial-max vector quantization (MAXVQ) to estimate real-value masks in CASA framework, a robust front-end for speech recognition is constructed. Evaluations on speech separation challenge (SSC) showed that the proposed system won 15.68% improvement over the baseline system. The results of evaluation also proved the validity of the multi-speaker recognition and the real-value mask estimation module.
Speaker Recognition Using DMFCC over Telephone Channels

WANG Gang,ZHENG Thomas Fang

DOI: https://doi.org/10.3321/j.issn:1000-0054.2009.10.006

2009-01-01

Abstract:Discriminative Mel frequency cepstrum coefficients (DMFCCs) are modified Mel frequency cepstrum coefficients (MFCC) which emphasize discriminative information carried by sub-bands of the audio spectrum with adaptive non-uniform filter bank settings. The effects of DMFCC , have been proven in wide-band signal applications, but not in narrow-band signal applications. This study analyzes the use of DMFCC for speaker recognition over telephone channels. With the NIST Speaker Recognition Evaluation 2006 Female core test set, the DMFCC based system achieves an equal error rate (EER) of 7.25% compared to the MFCC based system error rate of 7.57%. The system further achieves an EER of 6. 31% with a logical auto regression linear fusion of DMFCC and MFCC in the scoring domain, giving an EER reduction of 16.6% compared with the MFCC based system. Tests show that the DMFCC can slightly improve identification performance over telephone channels. Theoretical and experimental results show that DMFCC and MFCC are complimentary with fusion of the two methods substantially improving performance over telephone channels.
Enhancing 3d face recognition by combination of voiceprint

Yueming Wang,Gang Pan,Yingchun Yang,Dongdong Li,Zhaohui Wu

DOI: https://doi.org/10.1007/11758501_60

2006-01-01

Abstract:This paper investigates the enhancement of identification performance when using voice classifier to help 3D face recognition. 3D face recognition is well known for its being superior to 2D due to the invariance in illumination, make-ups and pose. However, it is still challenged by expression variance. The partial ICP method we used for 3D face recognition could implicitly and dynamically extract the rigid parts of facial surface and be able to get much better performance than other methods in 3D face recognition under expression changes. This work serves to further improve the performance of recognition by combining a voiceprint classifier into partial ICP method. We implement 9 combination schemes, and experiments on database of 360 models with 40 subjects, 9 3D face scans with four different kinds of expression and 9 sessions of utterance for each subject, shows improvement of performance is very promising.
An Auditory Feature Extraction Method Based on Forward-Masking and Its Application in Robust Speaker Identification and Speech Recognition.

Zhimin Liu,Xihong Wu,Bin Zhen,Huisheng Chi

DOI: https://doi.org/10.21437/icslp.2000-260

2000-01-01

Abstract:: This article presents a new auditory feature extraction method, which considers the forward-masking mechanism of auditory nerves and feasible in practice. Two features based on this method are extracted: FMFRC (forward masking firing-rate cepstrum) and FMSRC (forward masking synchronized rate cepstrum). Isolate-word speech recognition and text-dependent speaker identification experiments based on TI46 are conducted. The experiment results show that the new auditory features has comparable performance with MFCC under clean environment but far better noise-resistant property than MFCC in both tasks.

Combining Speech Enhancement and Discriminative Feature Extraction for Robust Speaker Recognition

Design and implementation of a speaker recognition system

Multi-feature Combination for Speaker Recognition

Combining Speech Enhancement with Feature Post-processing for Robust Speech Recognition

Multi-resolution Time Frequency Feature and Complementary Combination for Short Utterance Speaker Recognition

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Further Feature Extraction and Its Application on Speaker Recognition

Further Feature Extraction for Speaker Recognition

A High-Performance Auditory Feature for Robust Speech Recognition

Robust Speaker Identification Using An Auditory-Based Feature

An Auditory System-Based Feature for Robust Speech Recognition.

Combining Voiceprint and Face Biometrics for Speaker Identification Using SDWS.

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

Fusion of Embeddings Networks for Robust Combination of Text Dependent and Independent Speaker Recognition

Combining Mfcc And Pitch To Enhance The Performance Of The Gender Recognition

Speaker Recognition System in Multi-Channel Environment

Language Recognition Based on Acoustic Diversified Phone Recognizers and Phonotactic Feature Fusion

Robust Front-End for Speech Recognition Based on Computational Auditory Scene Analysis and Speaker Model

Speaker Recognition Using DMFCC over Telephone Channels

Enhancing 3d face recognition by combination of voiceprint

An Auditory Feature Extraction Method Based on Forward-Masking and Its Application in Robust Speaker Identification and Speech Recognition.