Abstract:Recently, we have proposed a general adaptation scheme for deep neural network based on discriminant condition codes and applied it to supervised speaker adaptation in speech recognition based on either frame-level cross-entropy or sequence-level maximum mutual information training criterion [1, 2, 3, 4]. In this case, each condition code is associated with one speaker in data, which is thus called speaker code for convenience. Our previous work has shown that speaker code based methods are quite effective in adapting DNNs even when only a very small amount of adaptation data is available. However, we have to use a large speaker code size and complex processes to obtain the best ASR performance since good initializations of speaker codes and connection weights are very important. In this paper, we propose a method using singular value decomposition (SVD) as in [5] to initialize speaker codes and connection weights to obtain a comparable ASR performance as before but with a smaller speaker code size and much less computation complexity. Meanwhile, we have evaluated unsupervised speaker adaptation with the proposed method in large vocabulary speech recognition in the Switchboard task. Experimental results have shown that it is effective for providing well initializations and suitable in adapting large DNN models.

An Unsupervised Speaker Adaptation Method Based on VQ-HMM

Agmma: A Novel Incremental Adaptation Method And Its Application To Speaker Recognition

A New Subspace Based Speaker Adaptation Method

Speaker-independent speech recognition based on HMM state-restructuring method

Speaker Adaptation of Hybrid NN/HMM Model for Speech Recognition Based on Singular Value Decomposition

A Combined Speaker Adaptation Method for Mandarin Speech Recognition

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Supervised And Unsupervised Speaker Adaptation Using Confidence Measure

Unsupervised Adaptation with Quality-Aware Masking to Improve Target-Speaker Voice Activity Detection for Speaker Diarization

Speech Recognition Using Speaker Adaptation by System Parameter Transformation.

Phoneme Dependent Speaker Embedding And Model Factorization For Multi-Speaker Speech Synthesis And Adaptation

Label Transform Based Cross-Language Speaker Adaptation in Bilingual (Mandarin-English) TTS

Voiced/unvoiced Decision Algorithm for HMM-based Speech Synthesis

An Efficient Robust Asr System Based On The Combination Of Speech Enhancement And Hmm Adaptation

HMM-based Speaker Identification System and Its Improvement

Unsupervised Speaker Adaptation Of Deep Neural Network Based On The Combination Of Speaker Codes And Singular Value Decomposition For Speech Recognition

VB-HMM Speaker Diarization with Enhanced and Refined Segment Representation.

The Improved VQ Algorithm for Speaker Recognition

A Speech Recognition System Based on a Hybrid HMM/SVM Architecture

An Appropriate Parallel HMM for Speaker-Independent Speech Recognition

Speaker adaptive bottleneck features extraction for LVCSR based on discriminative learning of speaker codes