Abstract:Emotion shapes all aspects of our interpersonal and intellectual experiences. Its automatic analysis has there-fore many applications, e.g., human-machine interface. In this paper, we propose an emotional tonal speech dataset, namely Mandarin Chinese Emotional Speech Dataset - Portrayed (MES-P), with both distal and proximal labels. In contrast with state of the art emotional speech datasets which are only focused on perceived emotions, the proposed MES-P dataset includes not only perceived emotions with their proximal labels but also intended emotions with distal labels, thereby making it possible to study human emotional intelligence, i.e. people emotion expression ability and their skill of understanding emotions, thus explicitly accounting for perception differences between intended and perceived emotions in speech signals and enabling studies of emotional misunderstandings which often occur in real life. Furthermore, the proposed MES-P dataset also captures a main feature of tonal languages, i.e., tonal variations, and provides recorded emotional speech samples whose tonal variations match the tonal distribution in real life Mandarin Chinese. Besides, the proposed MES-P dataset features emotion intensity variations as well, and includes both moderate and intense versions of recordings for joy, anger, and sadness in addition to neutral speech. Ratings of the collected speech samples are made in valence-arousal space through continuous coordinate locations, resulting in an emotional distribution pattern in 2D VA space. The consistency between the speakers' emotional intentions and the listeners' perceptions is also studied using Cohen's Kappa coefficients. Finally, we also carry out extensive experiments using a baseline on MES-P for automatic emotion recognition and compare the results with human emotion intelligence.

Articulatory and Acoustic Analyses of Mandarin Sentences with Different Emotions for Speaking Training of Dysphonic Disorders

Articulatory-Acoustic Analyses of Mandarin Words in Emotional Context Speech for Smart Campus

A Study of Correlation Between Physiological Process of Articulation and Emotions on Mandarin Chinese.

Acoustic Analysis of Emotional Speech in Mandarin Chinese

Mapping Acoustic Characteristics of Emotional Prosody in Mandarin Disyllabic Words: A Machine-Learning Approach

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

An Experimental Study of Emotional Speech in Mandarin and English

Acoustic and Articulatory Analysis on Japanese Vowels in Emotional Speech

Investigation of the Relation Between Acoustic Features and Articulation — an Application to Emotional Speech Analysis

Within and Across-Language Comparison of Vocal Emotions in Mandarin and English

Perceptual Study for Emotional Speech of Mandarin Chinese

An Emotional Text-Driven 3D Visual Pronunciation System for Mandarin Chinese

Acoustic Properties of Vowel Production in Mandarin-speaking Patients with Post-Stroke Dysarthria

Acoustic Effects of Speaker Sex, Speech Sample, and Mandarin Tone on Vowel Production of Poststroke Spastic Dysarthria

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels

The Mandarin Chinese auditory emotions stimulus database: A validated set of Chinese pseudo-sentences

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

Contribution of Glottal Waveform in Speech Emotion: A Comparative Pairwise Investigation

MES-P: an Emotional Tonal Speech Dataset in Mandarin with Distal and Proximal Labels

Quantitative acoustic metrics of vowel production in mandarin-speakers with post-stroke spastic dysarthria

Corpus Design and Prosody Study for Mandarin Affective Speech