Abstract:Hidden Markov models (HMMs) have been successfully applied to automatic speech recognition for more than 35 years in spite of the fact that a key HMM assumption -- the statistical independence of frames -- is obviously violated by speech data. In fact, this data/model mismatch has inspired many attempts to modify or replace HMMs with alternative models that are better able to take into account the statistical dependence of frames. However it is fair to say that in 2010 the HMM is the consensus model of choice for speech recognition and that HMMs are at the heart of both commercially available products and contemporary research systems. In this paper we present a preliminary exploration aimed at understanding how speech data depart from HMMs and what effect this departure has on the accuracy of HMM-based speech recognition. Our analysis uses standard diagnostic tools from the field of statistics -- hypothesis testing, simulation and resampling -- which are rarely used in the field of speech recognition. Our main result, obtained by novel manipulations of real and resampled data, demonstrates that real data have statistical dependency and that this dependency is responsible for significant numbers of recognition errors. We also demonstrate, using simulation and resampling, that if we `remove' the statistical dependency from data, then the resulting recognition error rates become negligible. Taken together, these results suggest that a better understanding of the structure of the statistical dependency in speech data is a crucial first step towards improving HMM-based speech recognition.

An inhomogeneous HMM speech recognition algorithm

Duration-Distribution-Based HMM for Speech Recognition

A study of duration in continuous speech recognition based on DDBHMM

HMM training method based on evolutionary computation and MDI in speech recognition

Improvement of hidden Markov model (HMM) for speech recognition

The Inhomogeneous HMM with General Topological Structure and Its Application in Language Identification between Mandarin and English

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Compensation for the Homogeneous Assumption of Classical HMM by Probability Penalty

Parametric model of introducing inter-frame correlation information into hidden markov model for speech recognition

A Speech Recognition System Based on a Hybrid HMM/SVM Architecture

Digital Speech Recognition Based on DDBHMM

Improved algorithm with duration information for continuous speech recognition

Continuous Speech Recognition Based on the Triphone DDBHMM

Noisy speech recognition performance of discriminative HMMs

Why has (reasonably accurate) Automatic Speech Recognition been so hard to achieve?

The speaking rate adaptation algorithm in Putonghua continuous speech recognition

One-stage Search Algorithm for Large Vocabulary Continuous Speech Recognition Based on DDBHMM

Using Frame Correlation Algorithm in A Duration Distribution Based Hidden Markov Model

A New Combined Model of Statics-Dynamics of Speech.

A combined model of statics-dynamics of speech optimized using maximum mutual information

The Cohort-Selection And Normalized Hidden Markov Model For Speaker Recognition