Abstract:Expressive speech synthesis has received increased attention in recent times. Stress (or pitch accent) is the perceptual prominence within words or utterances, which contributes to the expressivity of speech. This paper summarizes our contribution to Mandarin expressive speech synthesis. A novel hierarchical stress modeling and generation method for Mandarin is proposed and further integrated into HMM-based speech synthesis (HTS) and Fujisaki model-based speech synthesis systems to accurately model the undulation of pitch contour. In HMM-based expressive speech synthesis, stress-related contextual features obtained from the hierarchical model are introduced in modeling the prosodic variation caused by stress, in addition to the traditional prosodic features used in HTS. A rule-based and a Deep Belief Network based prosodic variation models are proposed and then used in stress adaptation module in HTS. The other approach uses the Fujisaki model to improve the expressiveness of synthetic speech. The hierarchical stress model is introduced into the phrase and tone command control mechanisms of the model. The pitch contour is then directly generated by the superposition of two-level commands of the Fujisaki model. Experimental results using the proposed hierarchical stress modeling and generation methods showed that the macro- and microcharacteristics of stress could be successfully captured. The methodology proposed in this paper has application to a range of areas such as conveying attitude and indicating focus in spoken dialog systems. (C) 2015 Elsevier B.V. All rights reserved.

Parsing Hierarchical Prosodic Structure For Mandarin Speech Synthesis

Prosodic Modeling with Rich Syntactic Context in HMM-based Mandarin Speech Synthesis

Improving Prosodic Boundaries Prediction For Mandarin Speech Synthesis By Using Enhanced Embedding Feature And Model Fusion Approach

Improving Mandarin Prosodic Structure Prediction with Multi-level Contextual Information

Hierarchical Prosody Analysis and Modeling for Emotional Conversions

Statistic Prosody Structure Prediction

Mandarin prosodic word prediction using dependency relationships

Hierarchical Stress Modeling in Mandarin Text-to-Speech

Towards Expressive Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis.

A Character-level Span-based Model for Mandarin Prosodic Structure Prediction

A Study on Chinese Prosodic Hierarchy Prediction Based on Dependency Grammar Analysis

Learning Prosodic Patterns for Mandarin Speech Synthesis

Data mining for learning mandarin prosodic models

A Maximum Entropy Based Hierarchical Model for Automatic Prosodic Boundary Labeling in Mandarin

Towards Multi-Scale Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis

HIERARCHICAL PROSODY MODELING FOR NON-AUTOREGRESSIVE SPEECH SYNTHESIS

Study of Data-Driven Hierarchical Prosody Generation Model for Chinese Sentence Utterance

Hierarchical Non-Uniform Unit Selection Based on Prosodic Structure

Hierarchical Stress Modeling and Generation in Mandarin for Expressive Text-to-Speech

Pitch Prediction for Mandarin TTS with Mutual Prosodic Constraint

A Two-stage Prosodic Structure Generation Strategy for Mandarin Text-to-speech Systems