Abstract:It is widely believed that strong correlations exist across an utterance as a consequence of time-invariant characteristics of speaker and acoustic environments. It is verified in this paper that the first primary eigendirections of the utterance covariance matrix are speaker dependent. Based on this observation, a novel family of fast speaker adaptation algorithms entitled Eigenspace Mapping (EigMap) is proposed. The proposed algorithms are applied to continuous density Hidden Markov Model (HMM) based speech recognition. The EigMap algorithm rapidly constructs discriminative acoustic models in the test speaker's eigenspace by preserving discriminative information learned from baseline models in the directions of the test speaker's eigenspace. Moreover, the adapted models are compressed by discarding model parameters that are assumed to contain no discrimination information. The core idea of EigMap can be extended in many ways, and a family of algorithms based on EigMap is described in this paper. Unsupervised adaptation experiments show that EigMap is effective in improving baseline models using very limited amounts of adaptation data with superior performance to conventional adaptation techniques such as MLLR and block diagonal MLLR. A relative improvement of 18.4% over a baseline recognizer is achieved using EigMap with only about 4.5 s of adaptation data. Furthermore, it is also demonstrated that EigMap is additive to MLLR by encompassing important speaker dependent discriminative information. A significant relative improvement of 24.6% over baseline is observed using 4.5 s of adaptation data by combining MLLR and EigMap techniques.

Mean and Covariance Adaptation Based on Minimum Classification Error Linear Regression for Continuous Density HMMs

HMM training method based on evolutionary computation and MDI in speech recognition

Regression class selection and speaker adaptation with MLLR in Mandarin continuous speech recognition

Model Adaptation for HMM-Based Speech Synthesis under Minimum Generation Error Criterion

Hidden Markov Model Adaptation Algorithm Using Maximum a Posteriori Nonlinear Transformation in Noisy Environments

Unified adaptation approach for robust speech recognition

Maximum Likelihood Sub-band Linear Regression for Robust Speech Recognition

Discriminative Learning of Additive Noise and Channel Distortions for Robust Speech Recognition

Robust Speech Recognition Method Based on Discriminative Learning of Environmental Features

Discriminative Speaker Adaptation with Eigenvoices

Discriminative Language Model Adaptation for Mandarin Broadcast Speech Transcription and Translation

Robust Speech Recognition Method Based on Discriminative Environment Feature Extraction

A Constrained Line Search Optimization For Discriminative Training In Speech Recognition

A Constrained Line Search Approach to General Discriminative HMM Training

Discriminative Transformation for Sufficient Adaptation in Text-Independent Speaker Verification

Training HMMs using a minimum error criterion with different loss measures

Latent Correlation Analysis of HMM Parameters for Speech Recognition

Maximum Likelihood Subband Polynomial Regression for Robust Speech Recognition

Rapid discriminative acoustic model based on eigenspace mapping for fast speaker adaptation

MCE-based Training of Subspace Distribution Clustering HMM

Adaptation of Hidden Markov Models Using Maximum Model Distance Algorithm