Abstract:Expressive speech synthesis has received increased attention in recent times. Stress (or pitch accent) is the perceptual prominence within words or utterances, which contributes to the expressivity of speech. This paper summarizes our contribution to Mandarin expressive speech synthesis. A novel hierarchical stress modeling and generation method for Mandarin is proposed and further integrated into HMM-based speech synthesis (HTS) and Fujisaki model-based speech synthesis systems to accurately model the undulation of pitch contour. In HMM-based expressive speech synthesis, stress-related contextual features obtained from the hierarchical model are introduced in modeling the prosodic variation caused by stress, in addition to the traditional prosodic features used in HTS. A rule-based and a Deep Belief Network based prosodic variation models are proposed and then used in stress adaptation module in HTS. The other approach uses the Fujisaki model to improve the expressiveness of synthetic speech. The hierarchical stress model is introduced into the phrase and tone command control mechanisms of the model. The pitch contour is then directly generated by the superposition of two-level commands of the Fujisaki model. Experimental results using the proposed hierarchical stress modeling and generation methods showed that the macro- and microcharacteristics of stress could be successfully captured. The methodology proposed in this paper has application to a range of areas such as conveying attitude and indicating focus in spoken dialog systems. (C) 2015 Elsevier B.V. All rights reserved.

Study on Stress Perception in Chinese Speech

AUTOMATIC STRESS PREDICTION OF CHINESE SPEECH SYNTHESIS

A Preliminary Study on Acoustic Correlates of Tone2+Tone2 Disyllabic Word Stress in Mandarin

Study on Automatic Prediction of Sentential Stress for Chinese Putonghua Text-to-Speech System with Natural Style

Study on Automatic Prediction of Sentential Stress with Natural Style in Chinese

Effects of pitch-slope-related parameters on stress perception of Tone 2 + Tone 2 disyllabic words in Mandarin

Hierarchical Stress Modeling in Mandarin Text-to-Speech

Mandarin Stress Analysis And Prediction For Speech Synthesis

The Perception of Disyllabic Word Stress of Chinese Speech in Utterance

Hierarchical Stress Modeling and Generation in Mandarin for Expressive Text-to-Speech

Influence of Rhythm and Tone Pattern on Mandarin Stress Perception in Continuous Speech

The Effect of Stress on Mandarin Tonal Perception in Continuous Speech for Spanish-speaking Learners

An Acoustic Study Of Chinese Efl Learners' Sentence Stress: From A Discourse-Prosodic Perspective

A Comparative Study on the Acoustic Characteristics of Stresses of Prosodic Words between Hearing-impaired and Normal-hearing Children

Hearer Model Based Stress Prediction for Chinese TTS System

Comparing Mandarin Lexical Stress Produced by Native Speakers and L2 Learners in Hong Kong

An Experimental Phonetic Study Of Corresponding Relation Between Information Focus And Sentence Stress

An Instrumental Study on the Word Stress in the Uighur Language

Hierarchical Stress Generation with Fujisaki Model in Expressive Speech Synthesis

Acoustic correlates of stress in speech perception

Detecting Syllable-Level Pronunciation Stress with A Self-Attention Model