Abstract:The choice of acoustic modeling units is critical to acoustic modeling in large vocabulary continuous speech recognition (LVCSR) tasks. The recent connectionist temporal classification (CTC) based acoustic models have more options for the choice of modeling units. In this work, we propose a DFSMN-CTC-sMBR acoustic model and investigate various modeling units for Mandarin speech recognition. In addition to the commonly used context-independent Initial/Finals (CI-IF), context-dependent Initial/Finals (CD-IF) and Syllable, we also propose a hybrid Character-Syllable modeling units by mixing high frequency Chinese characters and syllables. Experimental results show that DFSMN-CTC-sMBR models with all these types of modeling units can significantly outperform the well-trained conventional hybrid models. Moreover, we find that the proposed hybrid Character-Syllable modeling units is the best choice for CTC based acoustic modeling for Mandarin speech recognition in our work since it can dramatically reduce substitution errors in recognition results. In a 20,000 hours Mandarin speech recognition task, the DFSMN-CTC-sMBR system with hybrid Character-Syllable achieves a character error rate (CER) of 7.45% while performance of the well-trained DFSMN-CE-sMBR system is 9.49%.

Use Formant Trajectory to Improve the Performance of Mandarin Digit Speech Recognition

Use Tone Detection to Improve Performance of Mandarin Digit Speech Recognition

High Performance Digit Mandarin Speech Recognition

An Improved Linear Discriminant Analysis for Mandarin Digit Speech Recognition

Transformation techniques for mandarin digit string recognition

Discriminative Hmm Stream Model For Mandarin Digit String Speech Recognition

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Research work on the influence of training method in mandarin connected digit speech recognition

An Approach of Fundamental Frequencies Smoothing for Chinese Tone Recognition

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Preprocessing Improvement in Mime Speech Recognition based on Surface Electromyogram

Towards Robustness to Speech Rate in Mandarin All-Syllable Recognition

Mandarin accent identification based on GMM with multi-feature fusion

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

Mandarin-English bilingual phone modeling and combining MPE based Discriminative training for cross-language speech recognition

DURATION MODELING IN MANDARIN CONNECTED DIGIT RECOGNITION

LDA Applied to Mandarin Speech Recognition System

High Performance Mandarin Digit Recognition System on a DSP Chip

Mandarin Continuous Digit Speech Recognition System