Abstract:Research efforts in the field of TTS have placed emphasis on the naturalness in synthesized speech to facilitate various applications in Human-Computer Interaction (HCI). The ideal synthetic speech for HCI should not only have proper pronunciations, but also convey the appropriate semantics within the context of use. "Context" refers to the textual context of the document, the identity of the interlocutors in the interactive conversation, the application scenarios, etc. For example, synthetic speech for news reports may adopt lucid and smooth characters while sports commentaries may call for a more animated character. This paper focuses on expressive text-to-speech synthesis. Expressions in speech encompass many elements. Our work focuses on emotional and stylized synthetic speech in synthesizing speech. Emotion originates from the speakers' psychological and physical states and is realized through spectral and prosodic parameters. Style is dependent on the semantics of the spoken message and the conversation scenarios so that it can be realized with global prosodic features. Emotion and style are also interdependent. In general, emotion has relatively local effects and its acoustic parameters are more dynamic while style has relatively global effects and its acoustic parameters are more stable in the speech signals. Emotion and style thus jointly modify the acoustic features of the speech signal for more affective and effective conveyance of the underlying message. Thus a TTS system that can simulate different emotions and styles will make HCI more natural and desirable.

Specifying Intonation from Context for Speech Synthesis

Prosodic Prominence and Boundaries in Sequence-to-Sequence Speech Synthesis

Prosody Generation in Chinese Synthesis Using the Template of Quantified Prosodic Unit and Base Intonation Contour.

Analysis of Chinese Interrogative Intonation and Its Synthesis in HMM-Based Synthesis System

Synthesizing Expressive Speech to Convey Focus using a Perturbation Model for Computer-Aided Pronunciation Training

Using generative modelling to produce varied intonation for speech synthesis

Learning Phonotactics from Linguistic Informants

A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis

Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit

Quantitative Intonation Modeling of Interrogative Sentences for Mandarin Speech Synthesis

Coupling Phonology and Phonetics in a Constraint-Based Gestural Model

Applying Syntax$\unicode{x2013}$Prosody Mapping Hypothesis and Prosodic Well-Formedness Constraints to Neural Sequence-to-Sequence Speech Synthesis

Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesis

Modeling Prosody Patterns for Chinese Expressive Text-to-speech Synthesis

Prosody Analysis And Modeling For Emotional Speech Synthesis

Probing the phonetic and phonological knowledge of tones in Mandarin TTS models

A Computational Memory and Processing Model for Processing for Prosody

Accented Text-to-Speech Synthesis with Limited Data

Toward Synthesizing Expressive Mandarin Speech

Learning Prosodic Patterns for Mandarin Speech Synthesis

Controllable Prosody Generation With Partial Inputs