Abstract:Emotion shapes all aspects of our interpersonal and intellectual experiences. Its automatic analysis has there-fore many applications, e.g., human-machine interface. In this paper, we propose an emotional tonal speech dataset, namely Mandarin Chinese Emotional Speech Dataset - Portrayed (MES-P), with both distal and proximal labels. In contrast with state of the art emotional speech datasets which are only focused on perceived emotions, the proposed MES-P dataset includes not only perceived emotions with their proximal labels but also intended emotions with distal labels, thereby making it possible to study human emotional intelligence, i.e. people emotion expression ability and their skill of understanding emotions, thus explicitly accounting for perception differences between intended and perceived emotions in speech signals and enabling studies of emotional misunderstandings which often occur in real life. Furthermore, the proposed MES-P dataset also captures a main feature of tonal languages, i.e., tonal variations, and provides recorded emotional speech samples whose tonal variations match the tonal distribution in real life Mandarin Chinese. Besides, the proposed MES-P dataset features emotion intensity variations as well, and includes both moderate and intense versions of recordings for joy, anger, and sadness in addition to neutral speech. Ratings of the collected speech samples are made in valence-arousal space through continuous coordinate locations, resulting in an emotional distribution pattern in 2D VA space. The consistency between the speakers' emotional intentions and the listeners' perceptions is also studied using Cohen's Kappa coefficients. Finally, we also carry out extensive experiments using a baseline on MES-P for automatic emotion recognition and compare the results with human emotion intelligence.

The development of a database of functional and emotional intonation in Chinese

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

Building a Chinese Natural Emotional Audio-Visual Database

The Mandarin Chinese auditory emotions stimulus database: A validated set of Chinese pseudo-sentences

Design, construction and evaluation of emotional multimodal pathological speech database

CHEAVD: a Chinese natural emotional audio–visual database

Research on the Application of Speech Database based on Emotional Feature Extraction in International Chinese Education and Teaching

CHAD: a chinese affective database

MASC: A Speech Corpus in Mandarin for Emotion Analysis and Affective Speaker Recognition

Emotional Voice Conversion: Theory, Databases and ESD

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels

CNAMD Corpus: A Chinese Natural Audiovisual Multimodal Database of Conversations for Social Interactive Agents

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

MES-P: an Emotional Tonal Speech Dataset in Mandarin with Distal and Proximal Labels

Design of General-Purpose Chinese Dialect Speech Database

E‐Speech: Development of a Dataset for Speech Emotion Recognition and Analysis

An Enhanced Speech Emotion Recognition System Based On Discourse Information

Tsinghua Facial Expression Database - A Database of Facial Expressions in Chinese Young and Older Women and Men: Development and Validation

A standardized database of Chinese emotional short videos based on age and gender differences

EmoSpeech: A Corpus of Emotionally Rich and Contextually Detailed Speech Annotations

An Expressive Mandarin Speech Corpus