Effects of communication channels and actor's gender on emotion identification by native Mandarin speakers

Yi Lin,Hongwei Ding
DOI: https://doi.org/10.21437/Interspeech.2020-1498
2020-01-01
Abstract:Communication channels and actor's gender have been increasingly reported to influence emotion perception, but past literature exploring these two factors has largely been disassociated. The present study examined how emotions expressed by actors of the two genders are perceived in three different sensory channels (i.e. face, prosody, and semantics). Eighty-eight native Mandarin participants (43 females and 45 males) were asked to identify the emotion displayed visually through face, or auditorily through prosody or semantics in a fixed-choice format, in which accuracy and reaction time were recorded. Results revealed that visual facial expressions were more accurately and rapidly identified, particularly when posed by female actors. Additionally, emotion perception in the auditory modality was modulated by actor's gender to a greater extent: emotional prosody yielded more accurate and faster responses when expressed by female than male actors, while emotional semantics produced better performances when presented by males. To sum up, paralinguistic (i.e., visual and prosodic) dominance effects are more evident in emotions expressed by female than male actors.
What problem does this paper attempt to address?