Speech recognition using continuous mixture density Hidden Markov Models

Hongbo Shi

1997-01-01

Abstract:This paper discusses a speech recognition system using the continuous mixture density Hidden Markov Model. We use a nonlinear programming method to proceed time warping about feature vector. Moreover, we present a method based on speech knowledge to initialize model.

What problem does this paper attempt to address?

On Semi-Continuous Hidden Markov Modeling

XD HUANG,KF LEE,HW HON

DOI: https://doi.org/10.1109/icassp.1990.115853

2002-01-01

Abstract:The semicontinuous hidden Markov model is used in a 1000-word speaker-independent continuous speech recognition system and compared with the continuous mixture model and the discrete model. When the acoustic parameter is not well modeled by the continuous probability density, it is observed that the model assumption problems may cause the recognition accuracy of the semicontinuous model to be inferior to the discrete model. A simple method based on the semicontinuous model is investigated, to re-estimate the vector quantization codebook without continuous probability density function assumptions. Preliminary experiments show that such reestimation methods are as effective as the semicontinuous model, especially when the continuous probability density function assumption is inappropriate
Speaker recognition using continuous density support vector machines

Xin Dong,Wu Zhaohui

DOI: https://doi.org/10.1049/el:20010741

2001-01-01

Electronics Letters

Abstract:A new classification system for text-independent speaker recognition is presented. This system combines the output probabilities of generative Gaussian mixture models and discriminative classifier support vector machines. The new method is tested on the YOHO database and achieves superior performance.
The Hidden Markov Model of co-articulation and its application to the continuous speech recognition

Tranzai Lee,Fang Zheng,Wenhu Wu,Daowen Chen

DOI: https://doi.org/10.1007/s11767-000-0037-5

2000-01-01

Journal of Electronics (China)

Abstract:The co-articulation is one of the main reasons that makes the speech recognition difficult. However, the traditional Hidden Markov Models(HMM) can not model the co-articulation, because they depend on the first-order assumption. In this paper, for modeling the co-articulation, a more perfect HMM than traditional first order HMM is proposed on the basis of the authors’ previous works(1997, 1998) and they give a method in that this HMM is used in continuous speech recognition by means of multilayer perceptrons(MLP), i.e. the hybrid HMM/MLP method with triple MLP structure. The experimental result shows that this new hybrid HMM/MLP method decreases error rate in comparison with authors’ previous works.
A Comparative Study of Discrete, Semicontinuous, and Continuous Hidden Markov Models.

X.D. Huang,H.W. Hon,M.Y. Hwang,K.F. Lee

DOI: https://doi.org/10.1006/csla.1993.1019

IF: 3.252

1993-01-01

Computer Speech & Language

Abstract:In this paper, we first extended the semicontinuous hidden Markov model to incorporate multiple code-books. The robustness of the semicontinuous output probability is enhanced by the combination of multiple codewords and multiple codebooks. In addition, we compared the semicontinuous model with the continuous mixture model and the discrete model in a large-vocabulary speaker-independent continuous speech recognition (DARPA resource management) task. The model assumption and parameter size issues are addressed in particular through these experiments. When the acoustic parameters are not well modelled by the continuous probability density, the model assumption problems may cause the recognition accuracy of the semicontinuous model or the continuous mixture model to be inferior to the discrete model. We also found that the SCHMM can have a large number of free parameters in comparison with the discrete HMM because of its smoothing ability. With explicit male and female clustered models and for conditional feature sets, we were able to reduce the error rate of discrete-model-based SPHINX by more than 20%.
Multiple Codebook Semi-Continuous Hidden Markov Models for Speaker-Independent Continuous Speech Recognition

Xuedong Huang,Hsiao‐Wuen Hon,Kai‐Fu Lee

1989-01-01

Abstract:A semi-continuous hidden Markov model based on the multiple vector quantization codebooks is used here for large-vocabulary speaker-independent continuous speech recognition. In the techniques employed here, the semi-continuous output probability density function for each codebook is represented by a combination of the corresponding discrete output probabilities of the hidden Markov model and the continuous Gaussian density functions of each individual codebook. Parameters of the vector quantization codebook and the hidden Markov model are mutually optimized to achieve an optimal model/codebook combination under a unified probabilistic framework. Another advantage of this approach is the enhanced robustness of the semi-continuous output probability density function by the combination of multiple codewords and multiple codebooks. For a 1000-word speaker-independent continuous speech recognition using a word-pair grammar, the recognition error rate of the semi-continuous hidden Markov model was reduced by more than 29% and 40% in comparison to the discrete and continuous mixture hidden Markov model respectively. This research was sponsored in part by the Defense Advanced Research Projects Agency under Contract N00039-85-C-0163. The views and conclusions contained in this document are those of the author and should not be interpreted as representing the official policies, either expressed or implied, of the Defense Advanced Research Projects Agency, or the US Government. X.D. Huang is a holder of an Edinburgh University Studentship and ORS Awards. Visiting scientist from CSTR, University of Edinburgh, 80, South Bridge, Edinburgh EH1 1HN, Scodand
Improvement of hidden Markov model (HMM) for speech recognition

Puming Zhan,Zuoying Wang,Dajin Lu

1994-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:A new model was proposed here which is constructed by combining the first order Markov model with a multi-variable Gaussian density which can depict the temporal dependence of speech signal. The reasonableness of the new model was discussed theoretically. The experiment for all 409 Chinese syllables recognition (with tone disregarded) shows that the recognition rate of the new model is always significantly better than that of HMM. Furthermore, a discrete smoothed statistical histogram was used to model the state duration, because we found in the experiment that continuous density function, such as Gaussian, Gamma etc., can not satisfactorily depict the state duration of either HMM or the new model.
A New Model for Speech Recognition : Center-Distance Continuous Probability Model

Fang ZHENG,WU Wenhu,Ditang FANG

2001-01-01

Abstract:In this paper a new statistic model named Center-Distance Continuous Probability Model (CDCPM) is proposed for speech recognition, which is based on Center-Distance Normal (CDN) distribution. In a CDCPM, state parameters for each mixture include a mean vector and a CDN distribution parameter. Unlike the continuous Hidden Markov Model (CHMM), it preserves only the observation probability density function (PDF) matrix B, in which PDFs are always mono-dimensional ones and the scoring scheme is based on Embedded Multi-Model (EMM) scheme. The experimental results across a giant Chinese speech database and a real-world continuous-manner 2000 phrase system show that this model is a powerful one, which extremely reduces the space and time complexities, preserving good performance.
Speaker Identification Based on the Time-Delay Hierarchical Mixture of Experts

K Chen,DH Xie,HS Chi

DOI: https://doi.org/10.1109/icnn.1995.488992

1995-01-01

Abstract:In this paper, we explore the hierarchical mixture of experts (HME) architecture for a substantial problem, that of text-dependent speaker identification. For a specific multiway classification, we propose a generalized Bernolli density instead of the multinomial logit density. Time-delay technique is also introduced to HME for spatio-temporal processing. Using the proposed density and the time-delay HME along with the EM algorithm, we show that the system has a satisfactory performance and yields significantly fast training
Research of Speech Recognition for Detection of Program Behavior Based on CDHMM

Dan LI,Yong MING,Han-yu LU

DOI: https://doi.org/10.1109/ICETCE.2012.526

2012-01-01

Abstract:In order to reduce the error in the detection of speech recognition, improve the correct rate of speech recognition. This paper presents one improvement method of speech recognition program behavior detection based on continuous hidden Markov model (CDHMM). Through a simplified, deal with multi-dimensional discrete speech symbol program behavior detection method, making the continuous hidden Markov model can receive variety of different characteristic sequences at the same time. The problem of that speech authentication system recognition rate declining with time is resolved. Experiments show that the method reduces rejection rate and improves speech recognition system's adaptability.
Large Vocabulary Continuous Speech Recognition System Based on Hybrid Hidden Markov Model(HMM) and Artificial Neural Network (ANN)

JIANG Rui,LI Haifeng,MA Lin

DOI: https://doi.org/10.3969/j.issn.2095-2163.2012.05.007

2012-01-01

Abstract:This paper proposes a method of mandarin large vocabulary continuous speech recognition system based on hybrid Hidden Markov model(HMM) and Artificial Neural Network(ANN).In the system,a variety of models work together.ANN models realize phonetic properties,and HMM incorporates with linguistics model for recognizing utterances.In this way,the system can combine advantages of both ANN and HMM: HMM has high modeling ability on time sequence structure;ANN has strong ability of nonlinear prediction,modeling and robustness,as well as facilitation for hardware implementation.The experimental results show that the system effectively takes advantages of both ANN and HMM,and improves the performance.
A Hybrid Speech Recognition System Based on HMM/ANN

陈立伟,黄湘松

DOI: https://doi.org/10.3969/j.issn.1673-9728.2004.04.074

2004-01-01

Abstract:This paper proposed a hybrid model method combining Self-Organizing Feature Mapping neural network with Hidden Markov Model to train noise adapting HMM. The model trained by this method is conformable to recognize the speech in noisy environment. Compared with the traditional CDHMM and the CDHMM trained by additive noise into speech, this model have better noisy robustness. In the condition of SNR is low(2dB-12dB), the correct recognition rate increased distinctly.
A Novel HTS System Using both Continuous HMMs and Discrete HMMs

Jian Yu,Meng Zhang,Jianhua Tao,Xia Wang

2006-01-01

Abstract:The conventional HMM-based speech synthesis system (HTS) has encountered two over-smoothing problems in both time domain and frequency domain. To resolve these two problems, this paper presents a new HTS framework using both continuous HMMs and discrete HMMs. By the replacement of spectral envelope represented by continuous Gaussian distribution with that represented by discrete codevector, the over-smoothing problem in frequency domain can be resolved, and by the replacement of the parameter generation algorithm using dynamic features with a new well-designed codevector selection algorithm, the over-smoothing problem in time domain can also be better resolved. Experimental results show that the using of both continuous HMMs and discrete HMMs significantly improves the voice quality of synthesized speech. Keyword: Speech Synthesis, Hidden Markov Model, Speech Processing.
A New Hybrid Hmm/Ann Model For Speech Recognition

Xj Xi,Kh Lin,Cl Zhou,J Cai

DOI: https://doi.org/10.1007/0-387-29295-0_24

2005-01-01

Abstract:Because of the application of the Hidden Markov Model (HMM) in acoustic modeling, a significant breakthrough has been made in recognizing continuous speech with a large glossary. However, some unreasonable hypotheses for acoustic modeling and the unclassified training algorithm on which the HMM based form a bottleneck, restricting the further improvement in speech recognition. The Artificial Neural Network (ANN) techniques can be adopted as an alternative modeling paradigm. By means of the weight values of the network connections, neural networks can steadily store the knowledge acquired from the training process. But they possess a weak memory, not being suitable to store the instantaneous response to various input modes. To overcome the flaws of the HMM paradigm, we design a hybrid HMM/ANN model. In this hybrid model. the nonparametric probabilistic model (a BP neural network) is used to substitute the Gauss blender to calculate the observed probability which is necessary for computing the states of the HMM model. To optimizing the network structure in and after the training process, we propose an algorithm to prune hidden nodes in a trained neural network, and utilize the generalized Hebbian algorithm to reconfigure the parameters of the network. Some experiments show that the hybrid model has a good performance in speech recognition.
Continuous Speech Recognition Based on the Triphone DDBHMM

YOU Zhan,XIAO XI,WANG Zuoying

DOI: https://doi.org/10.3321/j.issn:1000-0054.2009.04.013

2009-01-01

Abstract:The HMM(hidden Markov model) is widely used in continuous speech recognition,but the recognition rate can still be improved.This paper presents a triphone DDBHMM(duration distribution based HMM) recognition method to improve the recognition performance.The triphone used for the continuous speech recognition was designed based on the Chinese language characteristics.MLSS(most likely state sequence) rules are described with a recognition network designed based on the frame-synchronous recognition algorithm.The triphone DDBHMM recognition method gives a 0.91% better recognition rate than the triphone HMM recognition method and 2.29% better rate than the diphone DDBHMM recognition method.Thus,this method significantly improves the recognition performance of continuous speech recognition.
A Dynamic Bayesian Network Based Framework for Continuous Speech Recognition and Its Token Passing Model

苗夺谦,王睿智,冉巍

2008-01-01

Journal of Computer Research and Development

Abstract:Hidden Markov models (HMMs) are the most commonly used stochastic model encoding acoustic features in speech recognition. The token passing model is an abstract model for HMM-based continuous speech recognition to uncouple acoustic models (HMMs) and the language model. Recently, there has been an increasing interest in a general class of probabilistic models: dynamic Bayesian networks (DBNs). Although a huge success of the introduction of DBNs into speech recognition in many areas, the frameworks and recognition algorithms for DBN-based continuous speech recognition are not as mature and flexible as those for HMM-based one. This paper is trying to propose a general framework to inherit most features of state-of-the-art HMM-based frameworks for continuous speech recognition and incorporate the interpretability, factorization and extensibility of DBNs into our framework. The token passing model is adapted for DBN-based continuous speech recognition to achieve this goal and a novel recognition algorithm independent of the upper-layer language model is proposed in this paper.
Recognition of Chinese Continuous Speech Based on 3-Dimension Viterbi Search

ZHAO Li,ZOU Cai-rong,WU Zhen-yang

DOI: https://doi.org/10.3321/j.issn:0372-2112.2000.07.018

2000-01-01

Abstract:This paper presents a recognition method of Chinese continuous speech,in which p honetic and prosodic features are integrated in terms of 3-Dimension Viterbi se arch.The phonetic information is modeled by 60 phonemic HMMs and the prosodic in formation by 8 tone HMMs.Both recognitions are synchronized based on 3-Dimensio n Viterbi search.A frame-synchronous parsing algorithm for CFG based on a top- down strategy is used for parsing processing.The task is related to the hotel re servation process,of which the perplexity is 27 3.For 1070 utterances produced by each of ten speakers,the average sentence recognition rate was 94 4%.
Stereo Hidden Markov Modeling for Noise Robust Speech Recognition

Xiaodong Cui,Mohamed Afify,Yuqing Gao,Bowen Zhou

DOI: https://doi.org/10.1016/j.csl.2011.08.002

IF: 3.252

2013-01-01

Computer Speech & Language

Abstract:This paper investigates a noise robust technique for automatic speech recognition which exploits hidden Markov modeling of stereo speech features from clean and noisy channels. The HMM trained this way, referred to as stereo HMM, has in each state a Gaussian mixture model (GMM) with a joint distribution of both clean and noisy speech features. Given the noisy speech input, the stereo HMM gives rise to a two-pass compensation and decoding process where MMSE denoising based on N-best hypotheses is first performed and followed by decoding the denoised speech in a reduced search space on lattice. Compared to the feature space GMM-based denoising approaches, the stereo HMM is advantageous as it has finer-grained noise compensation and makes use of information of the whole noisy feature sequence for the prediction of each individual clean feature. Experiments on large vocabulary spontaneous speech from speech-to-speech translation applications show that the proposed technique yields superior performance than its feature space counterpart in noisy conditions while still maintaining decent performance in clean conditions.
An inhomogeneous HMM speech recognition algorithm

Zuoying Wang,Hongge Gao

IF: 1.019

1998-01-01

Chinese Journal of Electronics

Abstract:The homogeneous Hidden Markov Model (HMM) for automatic speech recognition has been widely used today. But some significant defects of this method limit its performance and practical applications. One of these defects is that the stability of duration distribution of the speech states which is verified by experiments[1] is not correctly considered in the model. A new inhomogeneous Hidden Markov Model was proposed in [2] to overcome these defects. As the companion volume to [2], a duration distribution based inhomogeneous HMM (DDBHMM) recognition algorithm is introduced in this paper. A speaker-independent isolated-word Chinese speech recognition experiment is done and shows that DDBHMM reduces the error rate by about 20%.
Mean and Covariance Adaptation Based on Minimum Classification Error Linear Regression for Continuous Density HMMs

Haibin Liu,Zhenyang Wu

DOI: https://doi.org/10.21437/interspeech.2004-26

2004-01-01

Abstract:The performance of speech recognition system will be significantly deteriorated because of the mismatches between training and testing conditions. This paper addresses the problem and proposes an algorithm to adapt the mean and covariance of HMM simultaneously within the minimum classification error linear regression (MCELR) framework. Rather than estimating the transformation parameters using maximum likelihood estimation (MLE) or maximum a posteriori, we proposed to use minimum classification error (MCE) as the estimation criterion. The proposed algorithm, called IMCELR (Improved MCELR), has been evaluated on a Chinese digit recognition tasks based on continuous density HMM. The experiments show that the proposed algorithm is more efficient than maximum likelihood linear regression with the same amount of adaptation data.
FAST LIKELIHOOD COMPUTATION METHOD USING BLOCK-DIAGONAL COVARIANCE MATRICES IN HIDDEN MARKOV MODEL

Rui Wang,Xuan Zhu,Yining Chen,Jia Liu,Runsheng Liu

2002-01-01

Abstract:The paper presented a novel method to speed up the likelihood computation of the speech recognition system based continuous Hidden Markov Model (CHMM). The block-diagonal covariance matrices were applied in the method and the technique to construct an optimal block-diagonal matrix was introduced. The experimental results demonstrated that the block-diagonal covariance matrices could achieve a large improvement in recognition speed without significant decrease of recognition rate compared with baseline system.

Speech recognition using continuous mixture density Hidden Markov Models

On Semi-Continuous Hidden Markov Modeling

Speaker recognition using continuous density support vector machines

The Hidden Markov Model of co-articulation and its application to the continuous speech recognition

A Comparative Study of Discrete, Semicontinuous, and Continuous Hidden Markov Models.

Multiple Codebook Semi-Continuous Hidden Markov Models for Speaker-Independent Continuous Speech Recognition

Improvement of hidden Markov model (HMM) for speech recognition

A New Model for Speech Recognition : Center-Distance Continuous Probability Model

Speaker Identification Based on the Time-Delay Hierarchical Mixture of Experts

Research of Speech Recognition for Detection of Program Behavior Based on CDHMM

Large Vocabulary Continuous Speech Recognition System Based on Hybrid Hidden Markov Model(HMM) and Artificial Neural Network (ANN)

A Hybrid Speech Recognition System Based on HMM/ANN

A Novel HTS System Using both Continuous HMMs and Discrete HMMs

A New Hybrid Hmm/Ann Model For Speech Recognition

Continuous Speech Recognition Based on the Triphone DDBHMM

A Dynamic Bayesian Network Based Framework for Continuous Speech Recognition and Its Token Passing Model

Recognition of Chinese Continuous Speech Based on 3-Dimension Viterbi Search

Stereo Hidden Markov Modeling for Noise Robust Speech Recognition

An inhomogeneous HMM speech recognition algorithm

Mean and Covariance Adaptation Based on Minimum Classification Error Linear Regression for Continuous Density HMMs

FAST LIKELIHOOD COMPUTATION METHOD USING BLOCK-DIAGONAL COVARIANCE MATRICES IN HIDDEN MARKOV MODEL