Abstract:Emotion is an important element in expressive speech synthesis. Unlike traditional discrete emotion simulations, this paper attempts to synthesize emotional speech by using "strong", "medium", and "weak" classifications. This paper tests different models, a linear modification model (LMM), a Gaussian mixture model (GMM), and a classification and regression tree (CART) model. The linear modification model makes direct modification of sentence F0 contours and syllabic durations from acoustic distributions of emotional speech, such as, F0 topline, F0 baseline, durations, and intensities. Further analysis shows that emotional speech is also related to stress and linguistic information. Unlike the linear modification method, the GMM and CART models try to map the subtle prosody distributions between neutral and emotional speech. While the GMM just uses the features, the CART model integrates linguistic features into the mapping. A pitch target model which is optimized to describe Mandarin F0 contours is also introduced. For all conversion methods, a deviation of perceived expressiveness (DPE) measure is created to evaluate the expressiveness of the output speech. The results show that the LMM gives the worst results among the three methods. The GMM method is more suitable for a small training set, while the CART method gives the better emotional speech output if trained with a large context-balanced corpus. The methods discussed in this paper indicate ways to generate emotional speech in speech synthesis. The objective and subjective evaluation processes are also analyzed. These results support the use of a neutral semantic content text in databases for emotional speech synthesis

Synthesis of emotional speech based on prosody parameters

Prosody Analysis And Modeling For Emotional Speech Synthesis

Emotional Speech Synthesis Based on the Modification of Prosody Parameters and Spectral Envelope

Prosody Conversion from Neutral Speech to Emotional Speech.

Emotional Speech Synthesis System Based on PSOLA in Facial Speech Animation

Emotional speaker recognition based on similar neighbor phenomenon

Speech Synthesis with Mixed Emotions

Summary of Emotional Speech Synthesis

Emotional Audio-Visual Speech Synthesis Based on PAD

Emotional speech conversion based on spectrum-prosody dual transformation

Modifying Spectral Envelope to Synthetically Adjust Voice Quality and Articulation Parameters for Emotional Speech Synthesis

Emotional Speech Synthesis Based on PSOLA

A HMM-based Fuzzy Affective Model for Emotional Speech Synthesis

Controllable Multi-Speaker Emotional Speech Synthesis with Emotion Representation of High Generalization Capability

Study for HMM-based Trainable Emotional Speech Synthesis

Toward Synthesizing Expressive Mandarin Speech

Emotional Prosody Processing Between Artificial Voices and Human Voices

Multi-Level Prosody and Spectrum Conversion for Emotional Speech Synthesis

Speech emotion recognition by combining voice quality and prosody features

Mongolian Emotional Speech Synthesis Based on Transfer Learning and Emotional Embedding

EmoPro: A Prompt Selection Strategy for Emotional Expression in LM-based Speech Synthesis