Abstract:HMM-based automatic segmentation has been popularly used for corpus construction for concatenative speech synthesis. Since the most important reasons for the inaccuracy of HMM-based automatic segmentation are the HMM training criterion and duration control, we will study these particular issues. For the HMM training, we apply the discriminative training method and introduce a new criterion, named Minimum SeGmentation Error (MSGE). In this method, a loss function directly related to the segmentation error is defined, and parameter optimization is performed by the Generalized Probabilistic Descent (GPD) algorithm. For the duration control problem, we apply explicit duration models and propose a two-step-based segmentation method to solve the problem of computational cost, where the duration model is incorporated in a postprocessor procedure. From the experimental results, these two techniques significantly improve segmentation accuracy with different focuses, where the MSGE-based discriminative training focuses on improving the accuracy of sensitive boundary, i.e., a boundary where an error in segmentation is likely to cause a noticeable degradation in speech synthesis quality, and the explicit duration modeling focuses on eliminating large errors. After combining these two techniques, the error average was reduced from 6.86 ms to 5.79 ms on Japanese data, and from 8.67 ms to 6.61 ms on Chinese data. Simultaneously, the number of errors larger than 30 ms were reduced 25% and 51% on Chinese and Japanese data, respectively.

Training HMMs using a minimum error criterion with different loss measures

HMM training method based on evolutionary computation and MDI in speech recognition

Minimum Generation Error Training for HMM-Based Speech Synthesis

Full HMM Training for Minimizing Generation Error in Synthesis

Minimum Generation Error Training for HMM-based Prediction of Articulatory Movements

Performance of Discriminative HMM Training in Noise.

A New Minimum Divergence Approach To Discriminative Training

Learning Virtual HD Model for Bi-model Emotional Speaker Recognition

Minimum Divergence Based Discriminative Training.

Model Adaptation for HMM-Based Speech Synthesis under Minimum Generation Error Criterion

Minimum generation error training with weighted Euclidean distance on LSP for HMM-based speech synthesis

Minimum Unit Selection Error Training for HMM-based Unit Selection Speech Synthesis System

Minimum Divergence Based

Noisy speech recognition performance of discriminative HMMs

Discriminative Training and Explicit Duration Modeling for HMM-based Automatic Segmentation

Improvement Comparison of Different Lattice-based Discriminative Training Methods in Chinese-monolingual and Chinese-English-bilingual Speech Recognition

Discriminative training of GMM-HMM acoustic model by RPCL learning

Minimum Generation Error Training With Direct Log Spectral Distortion On Lsps For Hmm-Based Speech Synthesis

Modeling Pitch Trajectory by Hierarchical HMM with Minimum Generation Error Training.

Product HMM-based Training Method for Acoustic Model with Multiple-Size Units

Discriminative training of GMM-HMM acoustic model by RPCL type Bayesian Ying-Yang harmony learning