Abstract:Purpose: The Chinese Emotional Speech Audiometry Project (CESAP) aims to establish a new material set for Chinese speech audiometry tests, which can be used in both neutral and emotional prosody settings. As the first endeavor of CESAP, this study demonstrates the development of the material foundation and reports its validation in neutral prosody. Method: In the development step, 40 phonetically balanced word lists consisting of 30 Chinese disyllabic words with neutral valence were first generated. In a following affective rating experiment, 35 word lists were qualified for validation based on the familiarity and valence ratings from 30 normal-hearing (NH) participants. For validation, performance-intensity functions of each word list were fitted with responses from 60 NH subjects under six presentation levels (−1, 3, 5, 7, 11, and 20 dB HL). The final material set was determined by the intelligibility scores at each decibel level and the mean slopes. Results: First, 35 lists satisfied the criteria of phonetic balance, limited repetitions, high familiarity, and neutral valence and were selected for validation. Second, 15 lists were compiled in the final material set based on the pairwise differences in intelligibility scores and the fitted 20%–80% slopes. The established material set had high reliability and validity and was sensitive to detect intelligibility changes (50% slope: 6.20%/dB; 20%–80% slope: 5.45%/dB), with small covariance of variation for thresholds (15%), 50% slope (12%), and 20%–80% slope (12%). Conclusion: Our final material set of 15 word lists takes the initiative to control the emotional aspect of audiometry tests, which enriches available Mandarin speech recognition materials and warrants future assessments in emotional prosody among populations with hearing impairments. Supplemental Material: https://doi.org/10.23641/asha.25742814

Investigation on Pleasure Related Acoustic Features of Affective Speech

Acoustic and Physiological Feature Analysis of Affective Speech

Analysis and Modeling of Affective Audio Visual Speech Based on PAD Emotion Space

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

Affect Related Acoustic Features of Speech and Their Modification

Emotion recognition from sound stimuli based on back-propagation neural networks and electroencephalograms

Perceptual Study for Emotional Speech of Mandarin Chinese

Investigation of the Relation Between Acoustic Features and Articulation — an Application to Emotional Speech Analysis

Acoustic Analysis of Emotional Speech in Mandarin Chinese

MODELLING THE GLOBAL ACOUSTIC CORRELATES OF EXPRESSIVITY FOR CHINESE TEXT-TO-SPEECH SYNTHESIS

The Friendliness Perception of Dialogue Speech

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Affective Voice Interaction and Artificial Intelligence: A Research Study on the Acoustic Features of Gender and the Emotional States of the PAD Model

Mapping Acoustic Characteristics of Emotional Prosody in Mandarin Disyllabic Words: A Machine-Learning Approach

Chinese Emotional Speech Audiometry Project (CESAP): Establishment and Validation of a New Material Set With Emotionally Neutral Disyllabic Words

The Establishment and Assessment of a Native Affective Sound System

Acoustic Feature Analysis in Speech Emotion Primitives Estimation.

Emotional Audio-Visual Speech Synthesis Based on PAD

An Experimental Study of Emotional Speech in Mandarin and English

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels