Abstract:This paper presents a decision tree pruning method for the model clustering of HMM-based parametric speech synthesis by cross-validation (CV) under the minimum generation error (MGE) criterion. Decision-tree-based model clustering is an important component in the training process of an HMM based speech synthesis system. Conventionally, the maximum likelihood (ML) criterion is employed to choose the optimal contextual question from the question set for each tree node split and the minimum description length (MDL) principle is introduced as the stopping criterion to prevent building overly large tree models. Nevertheless, the MDL criterion is derived based on an asymptotic assumption and is problematic in theory when the size of the training data set is not large enough. Besides, inconsistency exists between the MDL criterion and the aim of speech synthesis. Therefore, a minimum cross generation error (MCGE) based decision tree pruning method for HMM-based speech synthesis is proposed in this paper. The initial decision tree is trained by MDL clustering with a factor estimated using the MCGE criterion by cross-validation. Then the decision tree size is tuned by backing-off or splitting each leaf node iteratively to minimize a cross generation error, which is defined to present the sum of generation errors calculated for all training sentences using cross-validation. Objective and subjective evaluation results show that the proposed method outperforms the conventional MDL-based model clustering method significantly.

Decision tree dynamic pruning method based on minimum description length in speech recognition

Cross-Validation and Minimum Generation Error Based Decision Tree Pruning for HMM-based Speech Synthesis

Research on the influence of decision tree structure on speaker adaptation

HMM training method based on evolutionary computation and MDI in speech recognition

Phonetic Speaker Recognition Using Maximum-Likelihood Binary-Decision Tree Models

Dynamic Data Pruning for Automatic Speech Recognition

Unit Feature Based Pruning of Large-Scale Speech Corpus Using Decision Tree

Decision tree based state tying for speech recognition using DNN derived embeddings

The Definition and Extension of the Question Set for Decision Tree Based State Tying in Chinese Speech Recognition

Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition

Extended Decision Tree with or Relationship for HMM-Based Speech Synthesis.

Combining Length Distribution Model with Decision Tree in Prosodic Phrase Prediction

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Context Adaptive Training with Factorized Decision Trees for HMM-based Statistical Parametric Speech Synthesis

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Acoustic Modeling Based On Chinese Phonetics Knowledge

Decision Tree Based Mandarin Tone Model And Its Application To Speech Recognition

Explaining the Attention Mechanism of End-to-End Speech Recognition Using Decision Trees

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

Script Design Based on Decision Tree with Context Vector and Acoustic Distance for Mandarin TTS.

Cluster Adaptive Training with Factorized Decision Trees for Speech Recognition