Abstract:How people recognize linguistic and emotional prosody in different listening conditions is essential for understanding the complex interplay between social context, cognition, and communication. The perception of both lexical tones and emotional prosody depends on prosodic features including pitch, intensity, duration, and voice quality. However, it is unclear which aspect of prosody is perceptually more salient and resistant to noise. This study aimed to investigate the relative perceptual salience of emotional prosody and lexical tone recognition in quiet and in the presence of multi-talker babble noise. Forty young adults randomly sampled from a pool of native Mandarin Chinese with normal hearing listened to monosyllables either with or without background babble noise and completed two identification tasks, one for emotion recognition and the other for lexical tone recognition. Accuracy and speed were recorded and analyzed using generalized linear mixed-effects models. Compared with emotional prosody, lexical tones were more perceptually salient in multi-talker babble noise. Native Mandarin Chinese participants identified lexical tones more accurately and quickly than vocal emotions at the same signal-to-noise ratio. Acoustic and cognitive dissimilarities between linguistic prosody and emotional prosody may have led to the phenomenon, which calls for further explorations into the underlying psychobiological and neurophysiological mechanisms.

Statistical Study on the Diversity of Pitch Parameters in Multilingual Speech

An Experimental Study of Emotional Speech in Mandarin and English

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Within and Across-Language Comparison of Vocal Emotions in Mandarin and English

Voice quality analysis under the pitch effect

Prosody Variation: Application to Automatic Prosody Evaluation of Mandarin Speech

DISCOVERY OF TYPICAL PITCH MODELS FROM MANDARIN SENTENCE SPEECH

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Effects of pitch-slope-related parameters on stress perception of Tone 2 + Tone 2 disyllabic words in Mandarin

Detectionoftimevaryingpitchintonallanguages: Anapproachbasedonensembleempirical Modedecomposition ∗

Evaluating the Relative Perceptual Salience of Linguistic and Emotional Prosody in Quiet and Noisy Contexts

Study of pitch of “dearing” as emotional speech

Mandarin Speech Synthesis Based on Pitch Synchronous Time-Frequency Interpolation

The Effects of Pitch and Duration on the Perception of the Neutral Tone in Standard Chinese

Adult Speech in Different Emotional States: Temporal and Spectral Features

Detection of Time Varying Pitch in Tonal Languages: an Approach Based on Ensemble Empirical Mode Decomposition

Pitch Models of Mandarin Text-to-speech

Single-channel speech separation integrating pitch information based on a multi task learning framework

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

Statistical Feature Selection for Mandarin Speech Emotion Recognition

The influence of language experience on categorical perception of pitch contours