Abstract:The choice of acoustic modeling units is critical to acoustic modeling in large vocabulary continuous speech recognition (LVCSR) tasks. The recent connectionist temporal classification (CTC) based acoustic models have more options for the choice of modeling units. In this work, we propose a DFSMN-CTC-sMBR acoustic model and investigate various modeling units for Mandarin speech recognition. In addition to the commonly used context-independent Initial/Finals (CI-IF), context-dependent Initial/Finals (CD-IF) and Syllable, we also propose a hybrid Character-Syllable modeling units by mixing high frequency Chinese characters and syllables. Experimental results show that DFSMN-CTC-sMBR models with all these types of modeling units can significantly outperform the well-trained conventional hybrid models. Moreover, we find that the proposed hybrid Character-Syllable modeling units is the best choice for CTC based acoustic modeling for Mandarin speech recognition in our work since it can dramatically reduce substitution errors in recognition results. In a 20,000 hours Mandarin speech recognition task, the DFSMN-CTC-sMBR system with hybrid Character-Syllable achieves a character error rate (CER) of 7.45% while performance of the well-trained DFSMN-CE-sMBR system is 9.49%.

DECISION TREE BASED UNIT PRE-SELECTION IN MANDARIN CHINESE SYNTHESIS

A Decision Tree Based Approach for Construction of Speech Database and Unit Selection

A Novel Hybrid Approach for Mandarin Speech Synthesis

Unit Feature Based Pruning of Large-Scale Speech Corpus Using Decision Tree

Script Design Based on Decision Tree with Context Vector and Acoustic Distance for Mandarin TTS.

Hierarchical Non-Uniform Unit Selection Based on Prosodic Structure

A Novel Hybrid Mandarin Speech Synthesis System Using Different Base Units for Model Training and Concatenation

Statistical Acoustic Model Based Unit Selection Algorithm for Speech Synthesis

A novel unit selection method for concatenation speech system using similarity measure

A Tree-Based Model of Prosodic Phrasing for Chinese Text-to-Speech Systems

Improved unit selection speech synthesis method utilizing subjective evaluation results on synthetic speech

ToneUnit: A Speech Discretization Approach for Tonal Language Speech Synthesis

Perceptual Clustering Based Unit Selection Optimization for Concatenative Text-to-speech Synthesis

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

CARD Based Context Specified Weights Training Algorism for Unit Selection in Speech Synthesis

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

A Character-level Span-based Model for Mandarin Prosodic Structure Prediction

Corpus Analysis Based on Decision Tree

Text-based Unstressed Syllable Prediction in Mandarin.

The Definition and Extension of the Question Set for Decision Tree Based State Tying in Chinese Speech Recognition

A Hierarchical Viterbi Algorithm For Mandarin Hybrid Speech Synthesis System