Abstract:AbstractEmotion-related feature extraction is a challenging task in speech emotion recognition. Due to the lack of discriminative acoustic features, classical approaches based on traditional acoustic features could not provide satisfactory performances. This research proposes a novel type of feature related to prominence, which, together with traditional acoustic features, are used to classify seven typical different emotional states. To this end, the author group produces a Chinese Dual-mode Emotional Speech Database (CDESD), which contains additional prominence and paralinguistic annotation information. Then, a consistency assessment algorithm is presented to validate the reliability of the annotation information of this database. The results show that the annotation consistency on prominence reaches more than 60% on average. Subsequently, this research analyzes the correlation of the prominence features with emotional states using a curve fitting method. Prominence is found to be closely related to emotion states, to retain emotional information at the word level to the greatest possible extent and to play an important role in emotional expression. Finally, the proposed prominence features are validated on CDESD through speaker-dependent and speaker-independent experiments with four commonly used classifiers. The results show that the average recognition rate achieved using the combined features is improved by 6% in speaker-dependent experiments and by 6.2% in speaker-independent experiments compared with that achieved using only acoustic features.

The Prominence Analysis and Synthesis of Emphasis in Putonghua

Synthesizing English Emphatic Speech for Multimodal Corrective Feedback in Computer-Aided Pronunciation Training.

Generating emphatic speech with hidden Markov model for expressive speech synthesis

Effects of Mandarin Tones on Acoustic Cue Weighting Patterns for Prominence.

Analysis and Synthesis of Continuous Voice Pitch Contour for Improving Chinese Synthetic Speech Naturalness

A Chinese Speech Synthesis System with Capability of Accent Realizing

Detection and Emphatic Realization of Contrastive Word Pairs for Expressive Text-to-speech Synthesis

Generating Emphasis from Neutral Speech Using Hierarchical Perturbation Model by Decision Tree and Support Vector Machine

TOWARDS SYNTHESIS OF FOCUS IN MANDARIN TEXT-TO-SPEECH SYSTEM

Controllable Emphatic Speech Synthesis Based on Forward Attention for Expressive Speech Synthesis

Synthesizing Expressive Speech to Convey Focus using a Perturbation Model for Computer-Aided Pronunciation Training

Native Listeners’ Evaluation of Natural and Synthesized Prosody in Mandarin of American Learners

Perceptual Evaluation of Natural and Synthesized Speech with Prosodic Focus in Mandarin Production of American Learners.

English emphatic speech conversion based on a decision tree

Intonation and Prosody Conversion for Expressive Mandarin Speech Synthesis

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Prominence features

Mandarin Stress Analysis And Prediction For Speech Synthesis

Interactive Prosodic Marking of Focus, Boundary and Newness in Mandarin

HMM-based Emphatic Speech Synthesis for Corrective Feedback in Computer-Aided Pronunciation Training

MODELLING THE GLOBAL ACOUSTIC CORRELATES OF EXPRESSIVITY FOR CHINESE TEXT-TO-SPEECH SYNTHESIS