Abstract:Expressive speech synthesis has received increased attention in recent times. Stress (or pitch accent) is the perceptual prominence within words or utterances, which contributes to the expressivity of speech. This paper summarizes our contribution to Mandarin expressive speech synthesis. A novel hierarchical stress modeling and generation method for Mandarin is proposed and further integrated into HMM-based speech synthesis (HTS) and Fujisaki model-based speech synthesis systems to accurately model the undulation of pitch contour. In HMM-based expressive speech synthesis, stress-related contextual features obtained from the hierarchical model are introduced in modeling the prosodic variation caused by stress, in addition to the traditional prosodic features used in HTS. A rule-based and a Deep Belief Network based prosodic variation models are proposed and then used in stress adaptation module in HTS. The other approach uses the Fujisaki model to improve the expressiveness of synthetic speech. The hierarchical stress model is introduced into the phrase and tone command control mechanisms of the model. The pitch contour is then directly generated by the superposition of two-level commands of the Fujisaki model. Experimental results using the proposed hierarchical stress modeling and generation methods showed that the macro- and microcharacteristics of stress could be successfully captured. The methodology proposed in this paper has application to a range of areas such as conveying attitude and indicating focus in spoken dialog systems. (C) 2015 Elsevier B.V. All rights reserved.

INTERNAL DEPENDENCE BASED F0 MODEL FOR MANDARIN TTS SYSTEM

A New Pitch Generation Model Based on Internal Dependence of Pitch Contour for Manadrin TTS System.

Pitch Prediction for Mandarin TTS with Mutual Prosodic Constraint

The Statistical Model of Chinese Word Contours Based on Fuzzy Clustering Method

Pitch Models of Mandarin Text-to-speech

Modeling Pitch Contour of Chinese Mandarin Sentences with the PENTA Model

An Optimized Neural Network Based Prosody Model of Chinese Speech Synthesis System

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Applying SFC Model for Chinese Expressive Speech Synthesis

A Hierarchical F0 Modeling Method for HMM-based Speech Synthesis

Hierarchical Stress Modeling and Generation in Mandarin for Expressive Text-to-Speech

A Novel Hybrid Approach for Mandarin Speech Synthesis

Cross-stream Dependency Modeling Using Continuous F0 Model for HMM-based Speech Synthesis

Modeling Incompletion Phenomenon in Mandarin Dialog Prosody.

A Novel Hybrid Mandarin Speech Synthesis System Using Different Base Units for Model Training and Concatenation

Cross-Stream Dependency Modeling for HMM-Based Speech Synthesis

Hierarchical Stress Generation with Fujisaki Model in Expressive Speech Synthesis

A Superposed Prosodic Model for Chinese Text-To-Speech Synthesis

Quantitative Intonation Modeling of Interrogative Sentences for Mandarin Speech Synthesis

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

DISCOVERY OF TYPICAL PITCH MODELS FROM MANDARIN SENTENCE SPEECH