Abstract:The modeling of fundamental frequency, or F0, in HMM-based speech synthesis is a critical factor in delivering speech which is both natural and accurately conveys all of the many nuances of the message. However, F0 modeling is difficult because F0 values are normally considered to depend on a binary voicing decision such that they are continuous in voiced regions and undefined in unvoiced regions. F0 is therefore a discontinuous function of time. Multi-space probability distribution HMM (MSDHMM) is a widely used solution to this problem. The MSDHMM essentially uses a joint distribution of discrete voicing labels and the discontinuous F0 observations. However, due to the discontinuity assumption, the MSDHMM provides a rather weak F0 trajectory model. In this paper, F0 is viewed as being a continuous function of time and this is achieved by assuming that F0 can be observed within unvoiced regions as well as voiced regions. This provides a continuous F0 data stream which can be modeled by standard HMMs. Voicing labels are modeled either implicitly or explicitly in order to perform voicing classification and a globally tied distribution (GTD) technique is used to achieve robust F0 estimation. Both objective measures and subjective listening tests demonstrate that continuous F0 modeling yields better synthesized F0 trajectories and significant improvements to the naturalness of synthesized speech compared to using the MSDHMM model.

Modeling DCT Parameterized F0 Trajectory at Intonation Phrase Level with DNN or Decision Tree

Modeling F0 Trajectories in Hierarchically Structured Deep Neural Networks.

Generating Mandarin and Cantonese F0 Contours with Decision Trees and BLSTMs

A Hierarchical F0 Modeling Method for HMM-based Speech Synthesis

An Investigation of the Target Approximation Model for Tone Modeling and Recognition in Continuous Mandarin Speech.

Tone Model Integration Using Tree Based Weight Parameter Tying in Mandarin Speech Recognition

Continuous F0 Modeling for HMM Based Statistical Parametric Speech Synthesis

Modeling Tone and Intonation in Mandarin and English As a Process of Target Approximation.

Modelling and Decision Tree Based Prediction of Pitch Contour in Ibm Mandarin Speech Synthesis System

Computational Modelling of Tone Perception Based on Direct Processing of F0 Contours

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

A Superposed Prosodic Model for Chinese Text-To-Speech Synthesis

Tone nucleus-based multi-level robust acoustic tonal modeling of sentential F0 variations for Chinese continuous speech tone recognition

Auditive Learning Based Chinese F0 Prediction

Direct F0 Incorporation for Acoustic Modeling in Mandarin Speech Recognition

Investigation of Prosodie FO Layers in Hierarchical FO Modeling for HMM-based Speech Synthesis

Statistical modeling of syllable-level F0 features for HMM-based unit selection speech synthesis

Modeling Pitch Trajectory by Hierarchical HMM with Minimum Generation Error Training.

Decision tree based state tying for speech recognition using DNN derived embeddings

Experiment on pitch target approximation model for generating Mandarin F0 contour

Acoustic Modeling Based On Chinese Phonetics Knowledge