Abstract:This paper compared the performance of different acoustic modeling units in deep neural networks (DNNs) based large vocabulary continuous speech recognition (LVCSR) systems for Chinese. Recently, the deep neural networks based acoustic modeling method has achieved very competitive performance for many speech recognition tasks, and has become the focus of current LVCSR research. Some previous work have studied the context independent and context dependent DNNs based acoustic models. For Chinese, a syllabic language, the choice of basic modeling units under the background of DNNs based LVCSR systems is a very important issue.Three basic modeling units, syllables, initial/finals, phones, are discussed and compared. Experimental results show that, in the DNNs based systems, the context dependent (CD) phones obtain the best performance, and the context independent (CI) syllables have the similar performance with the CD initial/finals. How the number of clustered states impacts on the performance of DNNs based systems is also discussed, which showed different properties from the GMMs based systems. Besides, through introducing the multi-task learning strategy, these multiple modeling units can be combined in the DNNs training procedure. The experimental results indicate that combining these multiple modeling units using multi-task learning outperforms each individual modeling unit.

Lhasa Dialect Recognition of Different Phonemes Based on TDNN Method.

Speech Recognition Based on Deep Neural Networks on Tibetan Corpus

Dynamic TF-TDNN: Dynamic Time Delay Neural Network Based on Temporal-Frequency Attention for Dialect Recognition

Phonotactic language recognition based on DNN-HMM acoustic model

Selection of acoustic modeling unit for Tibetan speech recognition based on deep learning

Deep Neural Network based Uyghur Large Vocabulary Continuous Speech Recognition

New Neural Network Architecture with Application in Mandarin Digit Speech Recognition

DLD: An Optimized Chinese Speech Recognition Model Based on Deep Learning

Fast learning algorithms for time-delay neural networks phoneme recognition

Improving Minority Language Speech Recognition Based on Distinctive Features

Research on acoustic Model of Putian Dialect Speech Recognition Based on Deep Learning

Phonetic Temporal Neural Model for Language Identification

Dynamic Multi-scale Convolution for Dialect Identification

Acoustic Modeling With Dfsmn-Ctc And Joint Ctc-Ce Learning

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

Automatic lexical stress and pitch accent detection for L2 English speech using multi-distribution deep neural networks

Speech recognition method based on DNN-LSTM combined with Wiener filtering algorithm

Acceleration Strategies for Speech Recognition Based on Deep Neural Networks

Modeling Speaker Variability Using Long Short-Term Memory Networks For Speech Recognition

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.

Improve Mispronunciation Detection with Tandem Feature