Abstract:Emotion is an important element in expressive speech synthesis. Unlike traditional discrete emotion simulations, this paper attempts to synthesize emotional speech by using "strong", "medium", and "weak" classifications. This paper tests different models, a linear modification model (LMM), a Gaussian mixture model (GMM), and a classification and regression tree (CART) model. The linear modification model makes direct modification of sentence F0 contours and syllabic durations from acoustic distributions of emotional speech, such as, F0 topline, F0 baseline, durations, and intensities. Further analysis shows that emotional speech is also related to stress and linguistic information. Unlike the linear modification method, the GMM and CART models try to map the subtle prosody distributions between neutral and emotional speech. While the GMM just uses the features, the CART model integrates linguistic features into the mapping. A pitch target model which is optimized to describe Mandarin F0 contours is also introduced. For all conversion methods, a deviation of perceived expressiveness (DPE) measure is created to evaluate the expressiveness of the output speech. The results show that the LMM gives the worst results among the three methods. The GMM method is more suitable for a small training set, while the CART method gives the better emotional speech output if trained with a large context-balanced corpus. The methods discussed in this paper indicate ways to generate emotional speech in speech synthesis. The objective and subjective evaluation processes are also analyzed. These results support the use of a neutral semantic content text in databases for emotional speech synthesis

Prosody Modification on Mixed-language Speech Synthesis

HMM Based TTS for Mixed Language Text.

Modeling Prosody Patterns for Chinese Expressive Text-to-speech Synthesis

Prosody Model for Mandarin Text-to-Speech System

Modeling prosody pattern of Chinese expressive speech and its application in personalized speech conversion

Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit

Prosody Analysis And Modeling For Emotional Speech Synthesis

A Novel Prosody Adaptation Method for Mandarin Concatenation-Based Text-to-speech System

Prosodic Modeling with Rich Syntactic Context in HMM-based Mandarin Speech Synthesis

Mandarin dialog prosody model

Towards Fine-Grained Prosody Control for Voice Conversion

Text Enhancement for Paragraph Processing in End-to-End Code-switching TTS

A New Prosodic Strength Calculation Method for Prosody Reduction Modeling

Prosody Conversion from Neutral Speech to Emotional Speech.

Modeling Incompletion Phenomenon in Mandarin Dialog Prosody.

Prosody Generation in Chinese Synthesis Using the Template of Quantified Prosodic Unit and Base Intonation Contour.

Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech

Pitch Prediction for Mandarin TTS with Mutual Prosodic Constraint

Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data

Learning Prosodic Patterns for Mandarin Speech Synthesis

Improving Prosodic Boundaries Prediction For Mandarin Speech Synthesis By Using Enhanced Embedding Feature And Model Fusion Approach