Abstract:This paper compared the performance of different acoustic modeling units in deep neural networks (DNNs) based large vocabulary continuous speech recognition (LVCSR) systems for Chinese. Recently, the deep neural networks based acoustic modeling method has achieved very competitive performance for many speech recognition tasks, and has become the focus of current LVCSR research. Some previous work have studied the context independent and context dependent DNNs based acoustic models. For Chinese, a syllabic language, the choice of basic modeling units under the background of DNNs based LVCSR systems is a very important issue.Three basic modeling units, syllables, initial/finals, phones, are discussed and compared. Experimental results show that, in the DNNs based systems, the context dependent (CD) phones obtain the best performance, and the context independent (CI) syllables have the similar performance with the CD initial/finals. How the number of clustered states impacts on the performance of DNNs based systems is also discussed, which showed different properties from the GMMs based systems. Besides, through introducing the multi-task learning strategy, these multiple modeling units can be combined in the DNNs training procedure. The experimental results indicate that combining these multiple modeling units using multi-task learning outperforms each individual modeling unit.

INTRA-SYLLABLE DEPENDENT PHONETIC MODELING FOR CHINESE SPEECH RECOGNITION

Improved context-dependent acoustic modeling for continuous Chinese speech recognition

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.

Context Dependent Initial/final Acoustic Modeling for Continuous Chinese Speech Recognition

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Context Dependent Syllable Acoustic Model For Continuous Chinese Speech Recognition

Acoustic Modeling Based On Chinese Phonetics Knowledge

MANDARIN PRONUNCIATION VARIATION MODELING 1

Modeling Pronunciation Variation Using Context-Dependent Weighting and B/s Refined Acoustic Modeling.

Mandarin Pronunciation Modeling Based on CASS Corpus.

Initial/final acoustic model based on separating nasal coda in Chinese Putonghua speech recognition

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Automatic Initial/Final Generation For Dialectal Chinese Speech Recognition

Asymmetric Acoustic Model for Accented Speech Recognition

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

A New Acoustic Modeling of Inter-Syllable Context-Dependent Units for Putonghua Continuous Speech Recognition

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

Reliable Accent-Specific Unit Generation With Discriminative Dynamic Gaussian Mixture Selection for Multi-Accent Chinese Speech Recognition

Acoustic Modeling With Dfsmn-Ctc And Joint Ctc-Ce Learning

Experiments and Analysis for Speaker Dependent Mandarin Syllable Recognition.

State Duration-Based Segmental Probability Model for Chinese Speech