Abstract:It is widely believed that strong correlations exist across an utterance as a consequence of time-invariant characteristics of speaker and acoustic environments. It is verified in this paper that the first primary eigendirections of the utterance covariance matrix are speaker dependent. Based on this observation, a novel family of fast speaker adaptation algorithms entitled Eigenspace Mapping (EigMap) is proposed. The proposed algorithms are applied to continuous density Hidden Markov Model (HMM) based speech recognition. The EigMap algorithm rapidly constructs discriminative acoustic models in the test speaker's eigenspace by preserving discriminative information learned from baseline models in the directions of the test speaker's eigenspace. Moreover, the adapted models are compressed by discarding model parameters that are assumed to contain no discrimination information. The core idea of EigMap can be extended in many ways, and a family of algorithms based on EigMap is described in this paper. Unsupervised adaptation experiments show that EigMap is effective in improving baseline models using very limited amounts of adaptation data with superior performance to conventional adaptation techniques such as MLLR and block diagonal MLLR. A relative improvement of 18.4% over a baseline recognizer is achieved using EigMap with only about 4.5 s of adaptation data. Furthermore, it is also demonstrated that EigMap is additive to MLLR by encompassing important speaker dependent discriminative information. A significant relative improvement of 24.6% over baseline is observed using 4.5 s of adaptation data by combining MLLR and EigMap techniques.

Latent Correlation Analysis of HMM Parameters for Speech Recognition

Maximum Likelihood I-Vector Space Using PCA for Speaker Verification.

Spatial Correlated Maximum A Posteriori Adaptation Algorithm

Parametric model of introducing inter-frame correlation information into hidden markov model for speech recognition

Eigenvoice-based MAP Adaptation Within Correlation Subspace

Probabilistic Latent Speaker Training for Large Vocabulary Speech Recognition

Adaptive Speaker Recognition Based on Hidden Markov Model Parameter Optimization

Evaluation Of Linear Regression For Speaker Adaptation In Hmm-Based Articulatory Movements Estimation

Eigenspace Estimation With Missing Values And Its Application To Eigenvoice Adaptation For Speech Recognition

Duration Weighted Gaussian Mixture Model Supervector Modeling for Robust Speaker Recognition.

An New Method Used in HMM for Modeling Frame Correlation.

Spatial Correlation Transformation for Speech Recognition

Eigenvoice-based MAP Fast Adaptation in Correlation Subspaces

Rapid discriminative acoustic model based on eigenspace mapping for fast speaker adaptation

Improved HMM Model Using Spatial Correlation

Non-linear probability estimation method used in HMM for modeling frame correlation

A New Method in Hidden Markov Model for Modeling Frame Correlation

A New Subspace Based Speaker Adaptation Method

Directly Modeling of Correlation Matrices for GMM in Speaker Identification

Discriminative Speaker Adaptation with Eigenvoices

New Adaptation Method Using Two-Dimensional Pca for Speaker Verification