Abstract:For producing high quality synthesis, a concatenation-based Text-to-Speech (TTS) system usually requires a large number of segmental units to cover various acoustic-phonetic contexts. However, careful manual labeling and segmentation by human experts, which is still the most reliable way to prepare such units, is labor intensive. In this paper we adopt a two-step procedure to automate the labeling, segmentation and refinement process. In the first step, coarse segmentation of speech data is performed by aligning speech signals with the corresponding sequence of Hidden Markov Models (HMMs). Then in the second step, segment boundaries are refined with a proposed Context-Dependent Boundary Model (CDBM). Classification and Regression Tree (CART) is adopted to organize available data into a structured hierarchical tree, where acoustically similar boundaries are clustered together to train tied CDBM models for boundary refinement. Optimal CDBM parameters and training conditions are found through a series of experimental studies. Comparing with manual segmentation reference, segmentation accuracy (within a tolerance of 20 ms) is improved by the CDBMs from 78.1% (baseline) to 94.8% in Mandarin Chinese and from 81.4% to 92.7% in English, with about 1,000 manually segmented sentences used in training the models. To further reduce the amount of manual data for training CDBMs of a new speaker, we adapt a well-trained CDBM via efficient adaptation algorithms. With only 10--20 manually segmented sentences as adaptation data, the adapted CDBM achieves a segmentation accuracy of 90%.

Spectral Continuity Measures at Mandarin Syllable Boundaries ?

Objective Distance Measures for Assessing Concatenative Speech Synthesis.

Automatic segmentation of Chinese Mandarin speech into syllable-like

Hybrid Model Method for Automatic Segmentation of Mandarin TTS Corpus

Comparison of Tonal Co-Articulation Between Intra- and Inter-Word Disyllables in Mandarin

Syllable-level modeling of voice aperiodicity contours for embedded Mandarin speech synthesis systems

Syllable HMM Based Mandarin TTS and Comparison with Concatenative TTS.

Prosodic Word Boundaries Prediction for Mandarin Text-to-Speech

Automatic Segmentation And Labeling Based On Boundary Type For Mandarin Chinese Speech

A Quantitative Study on Information Contribution of Prosody Phrase Boundaries in Chinese Speech

Predicting the Intelligibility of Mandarin Chinese with Manipulated and Intact Tonal Information for Normal-Hearing Listeners

Effects of Spectral and Temporal Cues to Mandarin Concurrent-Vowels Identification for Normal-Hearing and Hearing-Impaired Listeners

Mandarin and english use different temporal means to mark major prosodic boundaries

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages

Interactive Prosodic Marking of Focus, Boundary and Newness in Mandarin

Robustness of Tonal and Segmental Information in Noise - Auditory and Visual Contributions

The Duration Analysis of the Checked Tones in Cantonese Speech

Context-Dependent Boundary Model for Refining Boundaries Segmentation of TTS Units

Synchronising speech segments with musical beats in Mandarin and English singing

Prosodic boundary prediction based on maximum entropy model with error-driven modification