Abstract:Emotion shapes all aspects of our interpersonal and intellectual experiences. Its automatic analysis has there-fore many applications, e.g., human-machine interface. In this paper, we propose an emotional tonal speech dataset, namely Mandarin Chinese Emotional Speech Dataset - Portrayed (MES-P), with both distal and proximal labels. In contrast with state of the art emotional speech datasets which are only focused on perceived emotions, the proposed MES-P dataset includes not only perceived emotions with their proximal labels but also intended emotions with distal labels, thereby making it possible to study human emotional intelligence, i.e. people emotion expression ability and their skill of understanding emotions, thus explicitly accounting for perception differences between intended and perceived emotions in speech signals and enabling studies of emotional misunderstandings which often occur in real life. Furthermore, the proposed MES-P dataset also captures a main feature of tonal languages, i.e., tonal variations, and provides recorded emotional speech samples whose tonal variations match the tonal distribution in real life Mandarin Chinese. Besides, the proposed MES-P dataset features emotion intensity variations as well, and includes both moderate and intense versions of recordings for joy, anger, and sadness in addition to neutral speech. Ratings of the collected speech samples are made in valence-arousal space through continuous coordinate locations, resulting in an emotional distribution pattern in 2D VA space. The consistency between the speakers' emotional intentions and the listeners' perceptions is also studied using Cohen's Kappa coefficients. Finally, we also carry out extensive experiments using a baseline on MES-P for automatic emotion recognition and compare the results with human emotion intelligence.

ZCPA-based VAP Model in Speech Emotion

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Analysis and Modeling of Affective Audio Visual Speech Based on PAD Emotion Space

Emotional speaker recognition based on similar neighbor phenomenon

Emotional Speech Clustering Based Robust Speaker Recognition System

Deep Spectrum Feature Representations for Speech Emotion Recognition

Applying Emotional Factor Analysis And I-Vector To Emotional Speaker Recognition

Construction of virtual assistant based on basic emotions theory

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Valence-Arousal Model based Emotion Recognition using EEG, peripheral physiological signals and Facial Expression

The Study of a Five-Dimensional Emotional Model for Facial Emotion Recognition

Research on Modeling Method of Emotional Speech Recognition

A Dimensional Emotion Model Driven Multi-stage Classification of Emotional Speech

Study on Feature Subspace of Archetypal Emotions for Speech Emotion Recognition

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels

MES-P: an Emotional Tonal Speech Dataset in Mandarin with Distal and Proximal Labels

Emotion Detection from Speech to Enrich Multimedia Content

Learning Arousal-Valence Representation from Categorical Emotion Labels of Speech

Multi-stage Classification of Emotional Speech Motivated by a Dimensional Emotion Model

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

Facial Expression Synthesis Based on Emotion Dimensions for Affective Talking Avatar