Abstract:The hybrid deep neural network (DNN) and hidden Markov model (HMM) has recently achieved dramatic performance gains in automatic speech recognition (ASR). The DNN-based acoustic model is very powerful but its learning process is extremely time-consuming. In this paper, we propose a novel DNN-based acoustic modeling framework for speech recognition, where the posterior probabilities of HMM states are computed from multiple DNNs (mDNN), instead of a single large DNN, for the purpose of parallel training towards faster turnaround. In the proposed mDNN method all tied HMM states are first grouped into several disjoint clusters based on data-driven methods. Next, several hierarchically structured DNNs are trained separately in parallel for these clusters using multiple computing units (e.g. GPUs). In decoding, the posterior probabilities of HMM states can be calculated by combining outputs from multiple DNNs. In this work, we have shown that the training procedure of the mDNN under popular criteria, including both frame-level cross-entropy and sequence-level discriminative training, can be parallelized efficiently to yield significant speedup. The training speedup is mainly attributed to the fact that multiple DNNs are parallelized over multiple GPUs and each DNN is smaller in size and trained by only a subset of training data. We have evaluated the proposed mDNN method on a 64-hour Mandarin transcription task and the 320-hour Switchboard task. Compared to the conventional DNN, a 4-cluster mDNN model with similar size can yield comparable recognition performance in Switchboard (only about 2% performance degradation) with a greater than 7 times speed improvement in CE training and a 2.9 times improvement in sequence training, when 4 GPUs are used.

Phonotactic language recognition based on DNN-HMM acoustic model

Improved DNN-HMM English Acoustic Model Specially for Phonotactic Language Recognition

Mongolian acoustic modeling based on deep neural network

An Acoustic Model for English Speech Recognition Based on Deep Learning

Investigation on Acoustic Modeling with Different Phoneme Set for Continuous Lhasa Tibetan Recognition Based on Dnn Method

Mongolian Speech Recognition Based on Deep Neural Networks

State-Clustering Based Multiple Deep Neural Networks Modeling Approach for Speech Recognition

Research on Improving Phoneme Recognition Rate Based on Subspace Gaussian Mixture Model and Deep Neural Network Combination

An Investigation of High-Resolution Modeling Units of Deep Neural Networks for Acoustic Scene Classification

Mispronunciation Tendency Detection Using Deep Neural Networks

Improving deep neural network acoustic models using unlabeled data

Investigation of deep neural networks (DNN) for large vocabulary continuous speech recognition: Why DNN surpasses GMMS in acoustic modeling

Phonetic Temporal Neural Model for Language Identification

Improved Phonotactic Language Recognition Based on RNN Feature Reconstruction

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.

Improving Mandarin Tone Recognition Based on DNN by Combining Acoustic and Articulatory Features Using Extended Recognition Networks

Lhasa Dialect Recognition of Different Phonemes Based on TDNN Method.

Labeling Unsegmented Sequence Data with DNN-HMM and Its Application for Speech Recognition.

Speech recognition method based on DNN-LSTM combined with Wiener filtering algorithm

Large Vocabulary Continuous Speech Recognition System Based on Hybrid Hidden Markov Model(HMM) and Artificial Neural Network (ANN)