Abstract:A key task for speech recognition systems is to reduce the mismatch between training and evaluation data that is often attributable to speaker differences. Speaker adaptation techniques play a vital role to reduce the mismatch. Model-based speaker adaptation approaches often require sufficient amounts of target speaker data to ensure robustness. When the amount of speaker level data is limited, speaker adaptation is prone to overfitting and poor generalization. To address the issue, this paper proposes a full Bayesian learning based DNN speaker adaptation framework to model speaker-dependent (SD) parameter uncertainty given limited speaker specific adaptation data. This framework is investigated in three forms of model based DNN adaptation techniques: Bayesian learning of hidden unit contributions (BLHUC), Bayesian parameterized activation functions (BPAct), and Bayesian hidden unit bias vectors (BHUB). In the three methods, deterministic SD parameters are replaced by latent variable posterior distributions for each speaker, whose parameters are efficiently estimated using a variational inference based approach. Experiments conducted on 300-hour speed perturbed Switchboard corpus trained LF-MMI TDNN/CNN-TDNN systems suggest the proposed Bayesian adaptation approaches consistently outperform the deterministic adaptation on the NIST Hub5'00 and RT03 evaluation sets. When using only the first five utterances from each speaker as adaptation data, significant word error rate reductions up to 1.4% absolute (7.2% relative) were obtained on the CallHome subset. The efficacy of the proposed Bayesian adaptation techniques is further demonstrated in a comparison against the state-of-the-art performance obtained on the same task using the most recent systems reported in the literature.

Speaker recognition of Yunnan minority accent Based on bayesian network

Emotional speaker recognition based on similar neighbor phenomenon

Affect-Insensitive Speaker Recognition by Feature Variety Training

Automatic Speaker Recognition Using Dynamic Bayesian Network.

Dynamic Bayesian network approach to speaker identification

Dynamic bayesian networks for audio-visual speaker recognition

Bayesian Learning of LF-MMI Trained Time Delay Neural Networks for Speech Recognition

Bimodal speaker identification using dynamic bayesian network

Improving Blstm Rnn Based Mandarin Speech Recognition Using Accent Dependent Bottleneck Features

Speaker Identification Using Wavelet Shannon Entropy and Probabilistic Neural Network

Bayesian Learning for Deep Neural Network Adaptation

Speech Recognition Based on Deep Neural Networks on Tibetan Corpus

Investigation of Deep Neural Network Acoustic Modelling Approaches for Low Resource Accented Mandarin Speech Recognition

Look, Listen and Learn - A Multimodal LSTM for Speaker Identification

An Hmm/Mfnn Hybrid Architecture Based On Stacked Generalization For Speaker Identification

Multilingual Approach to Joint Speech and Accent Recognition with DNN-HMM Framework

Auditory Model Based Speech Feature Extraction and Its Application to Speaker Identification

Speaker Recognition Via Block Sparse Bayesian Learning

Improving Minority Language Speech Recognition Based on Distinctive Features

Speaker Identification Based on Classify Feature Sub-space Gaussian Mixture Model and Neural Net Fusion