Abstract:In this paper, an automatic and unsupervised method using context-dependent hidden Markov models (CD-HMMs) is proposed for the prosodic labeling of speech synthesis databases. This method consists of three main steps, i.e., initialization, model training and prosodic labeling. The initial prosodic labels are obtained by unsupervised clustering using the acoustic features designed according to the characteristics of the prosodic descriptor to be labeled. Then, CD-HMMs of the spectral parameters, Rh and phone durations are estimated by a means similar to the HMM-based parametric speech synthesis using the initial prosodic labels. These labels are further updated by Viterbi decoding under the maximum likelihood criterion given the acoustic feature sequences and the trained CD-HMMs. The model training and prosodic labeling procedures are conducted iteratively until convergence. The performance of the proposed method is evaluated on Mandarin speech synthesis databases and two prosodic descriptors are investigated, i.e., the prosodic phrase boundary and the emphasis expression. In our implementation, the prosodic phrase boundary labels are initialized by clustering the durations of the pauses between every two consecutive prosodic words, and the emphasis expression labels are initialized by examining the differences between the original and the synthetic F0 trajectories. Experimental results show that the proposed method is able to label the prosodic phrase boundary positions much more accurately than the text-analysis-based method without requiring any manually labeled training data. The unit selection speech synthesis system constructed using the prosodic phrase boundary labels generated by our proposed method achieves similar performance to that using the manual labels. Furthermore, the unit selection speech synthesis system constructed using the emphasis expression labels generated by our proposed method can convey the emphasis information effectively while maintaining the naturalness of synthetic speech.

Automatic Phrase Boundary Labeling for a Mandarin TTS Corpus Using the Viterbi Decoding Algorithm

Automatic Phrase Boundary Labeling for Mandarin TTS Corpus Using Context-Dependent HMM.

Unsupervised Prosodic Phrase Boundary Labeling Of Mandarin Speech Synthesis Database Using Context-Dependent Hmm

Automatic Phrase Boundary Labeling of Speech Synthesis Database Using Context-Dependent HMMs and N-Gram Prior Distributions

Prosodic Word Boundaries Prediction for Mandarin Text-to-Speech

A Hierarchical Viterbi Algorithm For Mandarin Hybrid Speech Synthesis System

Unsupervised Prosodic Labeling Of Speech Synthesis Databases Using Context-Dependent Hmms

Improved Decision Tree Based Method for English Prosodic Phrase Boundary Prediction

A Maximum Entropy Based Hierarchical Model for Automatic Prosodic Boundary Labeling in Mandarin

Automatic Prosodic Boundary Labeling Based on Fusing the Silence Duration with the Lexical Features

Automatic Conversion from Lexical Words to Prosodic Words for Mandarin Text-to-speech System

An unvoiced/voiced duration adjustment algorithm based on context features in mandarin TTS

Syllable HMM Based Mandarin TTS and Comparison with Concatenative TTS.

A Novel Prosody Adaptation Method for Mandarin Concatenation-Based Text-to-speech System

A Novel Hybrid Mandarin Speech Synthesis System Using Different Base Units for Model Training and Concatenation

Training Prosodic Phrasing Rules for Chinese TTS Systems

A Novel Hybrid Approach for Mandarin Speech Synthesis

Investigating Effect of Rich Syntactic Features on Mandarin Prosodic Boundaries Prediction

Automatic Prosody Annotation with Pre-Trained Text-Speech Model

Duration Model for post-processing in a Mandarin speech recognition system

Using Different Models to Label the Break Indices for Mandarin Speech Synthesis