Abstract:This paper presents a new discriminative approach for training Gaussian mixture models (GMMs) of hidden Markov models (HMMs) based acoustic model in a large vocabulary continuous speech recognition (LVCSR) system. This approach is featured by embedding a rival penalized competitive learning (RPCL) mechanism on the level of hidden Markov states. For every input, the correct identity state, called winner and obtained by the Viterbi force alignment, is enhanced to describe this input while its most competitive rival is penalized by de-learning, which makes GMMs-based states become more discriminative. Without the extensive computing burden required by typical discriminative learning methods for one-pass recognition of the training set, the new approach saves computing costs considerably. Experiments show that the proposed method has a good convergence with better performances than the classical maximum likelihood estimation (MLE) based method. Comparing with two conventional discriminative methods, the proposed method demonstrates improved generalization ability, especially when the test set is not well matched with the training set.

Discriminative GMM-HMM acoustic model selection using two-level bayesian ying-yang harmony learning

GMM-HMM Acoustic Model Training by a Two Level Procedure with Gaussian Components Determined by Automatic Model Selection

Discriminative training of GMM-HMM acoustic model by RPCL type Bayesian Ying-Yang harmony learning

Discriminative training of GMM-HMM acoustic model by RPCL learning

Dynamically regularized harmony learning of Gaussian mixtures

An iterative algorithm for BYY learning on Gaussian mixture with automated model selection

Conjugate and Natural Gradient Rules for BYY Harmony Learning on Gaussian Mixture with Automated Model Selection.

Agradient BYY harmony learning rule on Gaussian mixture with automated model selection

Byy Harmony Enforcing Regularization For Gaussian Mixture Learning

Discriminative Dynamic Gaussian Mixture Selection with Enhanced Robustness and Performance for Multi-Accent Speech Recognition

Two Further Gradient Byy Learning Rules For Gaussian Mixture With Automated Model Selection

An Annealing Approach to Byy Harmony Learning on Gaussian Mixture with Automated Model Selection

Dynamically regularized maximum likelihood learning of Gaussian mixtures

Parameter Estimation of Poisson Mixture with Automated Model Selection Through BYY Harmony Learning

BYY Harmony Learning on Finite Mixture: Adaptive Gradient Implementation and A Floating RPCL Mechanism

Performance of Discriminative HMM Training in Noise.

An adaptive BYY harmony learning algorithm and its relation to rewarding and penalizing competitive learning mechanism

An Adaptive Gradient BYY Learning Rule for Poisson Mixture with Automated Model Selection

Automatic Model Selection Algorithm Based on BYY Harmony Learning for Mixture of Gaussian Process Functional Regressions Models.

Automated Model Selection and Parameter Estimation of Log-Normal Mixtures via BYY Harmony Learning.

Improvement of hidden Markov model (HMM) for speech recognition