Abstract:Expressive speech synthesis has received increased attention in recent times. Stress (or pitch accent) is the perceptual prominence within words or utterances, which contributes to the expressivity of speech. This paper summarizes our contribution to Mandarin expressive speech synthesis. A novel hierarchical stress modeling and generation method for Mandarin is proposed and further integrated into HMM-based speech synthesis (HTS) and Fujisaki model-based speech synthesis systems to accurately model the undulation of pitch contour. In HMM-based expressive speech synthesis, stress-related contextual features obtained from the hierarchical model are introduced in modeling the prosodic variation caused by stress, in addition to the traditional prosodic features used in HTS. A rule-based and a Deep Belief Network based prosodic variation models are proposed and then used in stress adaptation module in HTS. The other approach uses the Fujisaki model to improve the expressiveness of synthetic speech. The hierarchical stress model is introduced into the phrase and tone command control mechanisms of the model. The pitch contour is then directly generated by the superposition of two-level commands of the Fujisaki model. Experimental results using the proposed hierarchical stress modeling and generation methods showed that the macro- and microcharacteristics of stress could be successfully captured. The methodology proposed in this paper has application to a range of areas such as conveying attitude and indicating focus in spoken dialog systems. (C) 2015 Elsevier B.V. All rights reserved.

Text-based sentential stress prediction using continuous lexical embedding for Mandarin speech synthesis

Mandarin Stress Analysis And Prediction For Speech Synthesis

Text-based Unstressed Syllable Prediction in Mandarin.

Hierarchical Stress Modeling in Mandarin Text-to-Speech

HMM-based Speech Synthesis with a Flexible Mandarin Stress Adaptation Model

Improve Word Embedding Using Both Writing and Pronunciation.

Stress Predicition for Mandarin Text-to-speech System Using Discourse Context Feature.

Hierarchical Stress Modeling and Generation in Mandarin for Expressive Text-to-Speech

Automatic prosody prediction for Chinese speech synthesis using BLSTM-RNN and embedding features

Improving Prosodic Boundaries Prediction For Mandarin Speech Synthesis By Using Enhanced Embedding Feature And Model Fusion Approach

AUTOMATIC STRESS PREDICTION OF CHINESE SPEECH SYNTHESIS

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Blstm-Crf Based End-To-End Prosodic Boundary Prediction With Context Sensitive Embeddings In A Text-To-Speech Front-End

Study on Automatic Prediction of Sentential Stress with Natural Style in Chinese

Improving Automatic Speech Recognition and Speech Translation Via Word Embedding Prediction

Influence of Rhythm and Tone Pattern on Mandarin Stress Perception in Continuous Speech

Improved BLSTM RNN Based Accent Speech Recognition Using Multi-task Learning and Accent Embeddings

Stress Annotation in Continuous Speech and Large-Scale Stress Corpus Construction

Pitch Prediction for Mandarin TTS with Mutual Prosodic Constraint

Hearer Model Based Stress Prediction for Chinese TTS System

Emphatic Speech Generation with Conditioned Input Layer and Bidirectional LSTMS for Expressive Speech Synthesis.