Abstract:Hidden Markov models (HMMs) have been successfully applied to automatic speech recognition for more than 35 years in spite of the fact that a key HMM assumption -- the statistical independence of frames -- is obviously violated by speech data. In fact, this data/model mismatch has inspired many attempts to modify or replace HMMs with alternative models that are better able to take into account the statistical dependence of frames. However it is fair to say that in 2010 the HMM is the consensus model of choice for speech recognition and that HMMs are at the heart of both commercially available products and contemporary research systems. In this paper we present a preliminary exploration aimed at understanding how speech data depart from HMMs and what effect this departure has on the accuracy of HMM-based speech recognition. Our analysis uses standard diagnostic tools from the field of statistics -- hypothesis testing, simulation and resampling -- which are rarely used in the field of speech recognition. Our main result, obtained by novel manipulations of real and resampled data, demonstrates that real data have statistical dependency and that this dependency is responsible for significant numbers of recognition errors. We also demonstrate, using simulation and resampling, that if we `remove' the statistical dependency from data, then the resulting recognition error rates become negligible. Taken together, these results suggest that a better understanding of the structure of the statistical dependency in speech data is a crucial first step towards improving HMM-based speech recognition.

Implementation and evaluation of a German HMM for POS disambiguation

A lexicalized second-order-HMM for ambiguity resolution in Chinese segmentation and POS tagging

Segmentation and Tagging Ambiguity for Chinese Using HMM

TAKTAG: Two-phase learning method for hybrid statistical/rule-based part-of-speech disambiguation

Token Identification Using HMM and PPM Models

Automatic Speech Recognition : A Study and Performance Evaluation on Neural Networks and Hidden Markov Models

hmBERT: Historical Multilingual Language Models for Named Entity Recognition

Massively parallel learning of part of speech disambiguation

Tagging and Morphological Disambiguation of Turkish Text

Joint Lemmatization and Morphological Tagging with LEMMING

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.

An Adaptive Harmony Search Part-of-Speech tagger for Square Hmong Corpus

Cross-Domain Evaluation of POS Taggers: From Wall Street Journal to Fandom Wiki

A Computational Model for the Assessment of Mutual Intelligibility Among Closely Related Languages

Why has (reasonably accurate) Automatic Speech Recognition been so hard to achieve?

Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging

The Study of a Nonstationary Maximum Entropy Markov Model and Its Application on the Pos-Tagging Task

Cross-Lingual Constituency Parsing for Middle High German: A Delexicalized Approach

Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging

DisMo: A Morphosyntactic, Disfluency and Multi-Word Unit Annotator. An Evaluation on a Corpus of French Spontaneous and Read Speech