Abstract:This paper presents a decision tree pruning method for the model clustering of HMM-based parametric speech synthesis by cross-validation (CV) under the minimum generation error (MGE) criterion. Decision-tree-based model clustering is an important component in the training process of an HMM based speech synthesis system. Conventionally, the maximum likelihood (ML) criterion is employed to choose the optimal contextual question from the question set for each tree node split and the minimum description length (MDL) principle is introduced as the stopping criterion to prevent building overly large tree models. Nevertheless, the MDL criterion is derived based on an asymptotic assumption and is problematic in theory when the size of the training data set is not large enough. Besides, inconsistency exists between the MDL criterion and the aim of speech synthesis. Therefore, a minimum cross generation error (MCGE) based decision tree pruning method for HMM-based speech synthesis is proposed in this paper. The initial decision tree is trained by MDL clustering with a factor estimated using the MCGE criterion by cross-validation. Then the decision tree size is tuned by backing-off or splitting each leaf node iteratively to minimize a cross generation error, which is defined to present the sum of generation errors calculated for all training sentences using cross-validation. Objective and subjective evaluation results show that the proposed method outperforms the conventional MDL-based model clustering method significantly.

Unit Feature Based Pruning of Large-Scale Speech Corpus Using Decision Tree

DECISION TREE BASED UNIT PRE-SELECTION IN MANDARIN CHINESE SYNTHESIS

Decision tree dynamic pruning method based on minimum description length in speech recognition

Script Design Based on Decision Tree with Context Vector and Acoustic Distance for Mandarin TTS.

A Decision Tree Based Approach for Construction of Speech Database and Unit Selection

Constructing Scalable TTS System Based on Corpus Approach

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Corpus Analysis Based on Decision Tree

SparseWAV: Fast and Accurate One-Shot Unstructured Pruning for Large Speech Foundation Models

Cross-Validation and Minimum Generation Error Based Decision Tree Pruning for HMM-based Speech Synthesis

Dynamic Data Pruning for Automatic Speech Recognition

A Tree-Based Model of Prosodic Phrasing for Chinese Text-to-Speech Systems

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis

Perceptual Clustering Based Unit Selection Optimization for Concatenative Text-to-speech Synthesis

Convexity-based Pruning of Speech Representation Models

Decision Tree Based Mandarin Tone Model And Its Application To Speech Recognition

A Synthesis Instance Pruning Approach Based on Virtual Non-Uniform Replacements

An Efficient Layer-Wised Beam Pruning Algorithm for Large Vocabulary Continuous Speech Recognition System

Task-Agnostic Structured Pruning of Speech Representation Models

Hierarchical Non-Uniform Unit Selection Based on Prosodic Structure