Abstract:In this paper, we have proposed two novel optimization methods for discriminative training (DT) of hidden Markov models (HMMs) in speech recognition based on an efficient global optimization algorithm used to solve the so-called trust region (TR) problem, where a quadratic function is minimized under a spherical constraint. In the first method, maximum mutual information estimation (MMIE) of Gaussian mixture HMMs is formulated as a standard TR problem so that the efficient global optimization method can be used in each iteration to maximize the auxiliary function of discriminative training for speech recognition. In the second method, we propose to construct a new auxiliary function for DT of HMMs by adding a quadratic penalty term. The new auxiliary function is constructed to serve as first-order approximation as well as lower bound of the original discriminative objective function within a locality constraint. Due to the lower-bound property, the found optimal point of the new auxiliary function is guaranteed to improve the original discriminative objective function until it converges to a local optimum or stationary point of the objective function. Both TR-based optimization methods have been investigated on two standard large-vocabulary continuous speech recognition tasks, using the WSJ0 and Switchboard databases. Experimental results have shown that the proposed TR methods outperform the conventional EBW method in terms of convergence behavior as well as recognition performance.

A combined model of statics-dynamics of speech optimized using maximum mutual information

A New Combined Model of Statics-Dynamics of Speech.

From Linear Prediction HMM to a New Combined Model for Speech Recognition

HMM training method based on evolutionary computation and MDI in speech recognition

A Trust Region Based Optimization For Maximum Mutual Information Estimation Of Hmms In Speech Recognition

Discriminative Dynamic Gaussian Mixture Selection with Enhanced Robustness and Performance for Multi-Accent Speech Recognition

Discriminative Combination of Multiple Linear Predictions for Speech Recognition.

Parametric model of introducing inter-frame correlation information into hidden markov model for speech recognition

A fused hidden Markov model with application to bimodal speech processing

Improvement of hidden Markov model (HMM) for speech recognition

Trust Region-Based Optimization for Maximum Mutual Information Estimation of HMMs in Speech Recognition

An equivalent-class based MMI learning method for MGCPM

An HMM Compensatioon Approach for Dynamic Features Using Unscented Transformation and Its Application to Noisy Speech Recognition

Duration-Distribution-Based HMM for Speech Recognition

A Discriminative Model Topology Optimization Method

A Maximum Likelihood Approach to Multi-Objective Learning Using Generalized Gaussian Distributions for Dnn-Based Speech Enhancement.

An inhomogeneous HMM speech recognition algorithm

Improved HMM Model Using Spatial Correlation

An New Method Used in HMM for Modeling Frame Correlation.

Discriminative Speaker Adaptation with Eigenvoices

Partial-tied-mixture Auxiliary Chain Models for Speech Recognition Based on Dynamic Bayesian Networks