Abstract:Emotion is an important element in expressive speech synthesis. Unlike traditional discrete emotion simulations, this paper attempts to synthesize emotional speech by using "strong", "medium", and "weak" classifications. This paper tests different models, a linear modification model (LMM), a Gaussian mixture model (GMM), and a classification and regression tree (CART) model. The linear modification model makes direct modification of sentence F0 contours and syllabic durations from acoustic distributions of emotional speech, such as, F0 topline, F0 baseline, durations, and intensities. Further analysis shows that emotional speech is also related to stress and linguistic information. Unlike the linear modification method, the GMM and CART models try to map the subtle prosody distributions between neutral and emotional speech. While the GMM just uses the features, the CART model integrates linguistic features into the mapping. A pitch target model which is optimized to describe Mandarin F0 contours is also introduced. For all conversion methods, a deviation of perceived expressiveness (DPE) measure is created to evaluate the expressiveness of the output speech. The results show that the LMM gives the worst results among the three methods. The GMM method is more suitable for a small training set, while the CART method gives the better emotional speech output if trained with a large context-balanced corpus. The methods discussed in this paper indicate ways to generate emotional speech in speech synthesis. The objective and subjective evaluation processes are also analyzed. These results support the use of a neutral semantic content text in databases for emotional speech synthesis

F0 Prediction Model of Speech Synthesis Based on Template and Statistical Method

Auditive Learning Based Chinese F0 Prediction

Clustering and Feature Learning Based F0 Prediction for Chinese Speech Synthesis

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

A Hierarchical F0 Modeling Method for HMM-based Speech Synthesis

Asynchronous F0 and Spectrum Modeling for HMM-based Speech Synthesis

Study of Prosody Model on Chinese Speech Synthesis Based on the Classification of Syllabic Prosody Features

Modeling F0 Trajectories in Hierarchically Structured Deep Neural Networks.

An Optimized Neural Network Based Prosody Model of Chinese Speech Synthesis System

Investigation of Prosodie FO Layers in Hierarchical FO Modeling for HMM-based Speech Synthesis

A Superposed Prosodic Model for Chinese Text-To-Speech Synthesis

Towards Expressive Zero-Shot Speech Synthesis with Hierarchical Prosody Modeling

F0 Transformation for Emotional Speech Synthesis Using Target Approximation Features and Bidirectional Associative Memories

Multi-Layer F0 Modeling for HMM-Based Speech Synthesis

Learning Prosodic Patterns for Mandarin Speech Synthesis

HMM based speech synthesis with Global Variance Training method

AUTOMATIC STRESS PREDICTION OF CHINESE SPEECH SYNTHESIS

An initial research: Towards accurate pitch extraction for speech synthesis based on BLSTM

Statistical modeling of syllable-level F0 features for HMM-based unit selection speech synthesis

The Statistical Model of Chinese Word Contours Based on Fuzzy Clustering Method

Prosody Conversion from Neutral Speech to Emotional Speech.