Abstract:For producing high quality synthesis, a concatenation-based Text-to-Speech (TTS) system usually requires a large number of segmental units to cover various acoustic-phonetic contexts. However, careful manual labeling and segmentation by human experts, which is still the most reliable way to prepare such units, is labor intensive. In this paper we adopt a two-step procedure to automate the labeling, segmentation and refinement process. In the first step, coarse segmentation of speech data is performed by aligning speech signals with the corresponding sequence of Hidden Markov Models (HMMs). Then in the second step, segment boundaries are refined with a proposed Context-Dependent Boundary Model (CDBM). Classification and Regression Tree (CART) is adopted to organize available data into a structured hierarchical tree, where acoustically similar boundaries are clustered together to train tied CDBM models for boundary refinement. Optimal CDBM parameters and training conditions are found through a series of experimental studies. Comparing with manual segmentation reference, segmentation accuracy (within a tolerance of 20 ms) is improved by the CDBMs from 78.1% (baseline) to 94.8% in Mandarin Chinese and from 81.4% to 92.7% in English, with about 1,000 manually segmented sentences used in training the models. To further reduce the amount of manual data for training CDBMs of a new speaker, we adapt a well-trained CDBM via efficient adaptation algorithms. With only 10--20 manually segmented sentences as adaptation data, the adapted CDBM achieves a segmentation accuracy of 90%.

The Definition and Extension of the Question Set for Decision Tree Based State Tying in Chinese Speech Recognition

Decision tree based state tying for speech recognition using DNN derived embeddings

Context Dependent Initial/final Acoustic Modeling for Continuous Chinese Speech Recognition

Improved context-dependent acoustic modeling for continuous Chinese speech recognition

Acoustic Modeling Based On Chinese Phonetics Knowledge

Script Design Based on Decision Tree with Context Vector and Acoustic Distance for Mandarin TTS.

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

Extended Decision Tree with or Relationship for HMM-Based Speech Synthesis.

Spoken Question Answering Using Tree-Structured Conditional Random Fields And Two-Layer Random Walk

DECISION TREE BASED UNIT PRE-SELECTION IN MANDARIN CHINESE SYNTHESIS

Context-Dependent Boundary Model for Refining Boundaries Segmentation of TTS Units

Algorithm for Mandarin Continuous Speech Recognition Based on Context-Dependent Unit Between Syllables

Context Dependent Syllable Acoustic Model For Continuous Chinese Speech Recognition

Initial/final acoustic model based on separating nasal coda in Chinese Putonghua speech recognition

A New Acoustic Modeling of Inter-Syllable Context-Dependent Units for Putonghua Continuous Speech Recognition

A Tree-Based Model of Prosodic Phrasing for Chinese Text-to-Speech Systems

Automatic Segmentation for TTS Units

State-dependent mixture tying with variable codebook size for accented speech recognition

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Automatic Initial/Final Generation For Dialectal Chinese Speech Recognition