Abstract:Speech signals contain information of both linguistic content and a talker's voice. Conventionally, linguistic and talker processing are thought to be mediated by distinct neural systems in the left and right hemispheres respectively, but there is growing evidence that linguistic and talker processing interact in many ways. Previous studies suggest that talker-related vocal tract changes are processed integrally with phonetic changes in the bilateral posterior superior temporal gyrus/superior temporal sulcus (STG/STS), because the vocal tract parameter influences the perception of phonetic information. It is yet unclear whether the bilateral STG is also activated by the integral processing of another parameter — pitch, which influences the perception of lexical tone information and is related to talker differences in tone languages. In this study, we conducted separate functional magnetic resonance imaging (fMRI) and event-related potential (ERP) experiments to examine the spatial and temporal loci of interactions of lexical tone and talker-related pitch processing in Cantonese. We found that the STG was activated bilaterally during the processing of talker changes when listeners attended to lexical tone changes in the stimuli and during the processing of lexical tone changes when listeners attended to talker changes, suggesting that lexical tone and talker processing are functionally integrated in the bilateral STG. It extends the previous study, providing evidence for a general neural mechanism of integral phonetic and talker processing in the bilateral STG. The ERP results show interactions of lexical tone and talker processing 500–800ms after auditory word onset (a simultaneous posterior P3b and a frontal negativity). Moreover, there is some asymmetry in the interaction, such that unattended talker changes affect linguistic processing more than vice versa, which may be related to the ambiguity that talker changes cause in speech perception and/or attention bias to talker changes. Our findings have implications for understanding the neural encoding of linguistic and talker information.

Interaction Between Lexical Tone and Intonation: an EMA Study

A Gestural Account of Mandarin Tone Sandhi

FO Patterns at the Boundary of Intonational Phrases:The Interaction of Focus, Lexical Stress and Boundary Tone

Comparison of Tonal Co-Articulation Between Intra- and Inter-Word Disyllables in Mandarin

Distinct but Integrated Processing of Lexical Tones, Vowels, and Consonants in Tonal Language Speech Perception: Evidence from Mismatch Negativity

Intonation processing increases task-specific fronto-temporal connectivity in tonal language speakers

Gestural Timing in Mandarin Tone Sandhi

The Affective Priming on Audiovisual Integration: the Dual Regulation from Facial Expression and Identity

Perception of Coarticulated Tones.

WHAT CAN TONE STUDIES TELL US ABOUT INTONATION?

Visual Timing Information in Audiovisual Speech Perception: Evidence from Lexical Tone Contour

The interaction between phonological information and pitch type at pre-attentive stage: an ERP study of lexical tones

The Influence on Realization and Perception of Lexical Tones from Affricate's Aspiration.

Syllabic Tone Articulation Influences the Identification and Use of Words During Chinese Sentence Reading: Evidence from ERP and Eye Movement Recordings.

Functionally integrated neural processing of linguistic and talker information: An event-related fMRI and ERP study

The Role of Tone in Chinese Syllable Perception

Acoustics and emotion in tonal and non-tonal languages: Findings from individuals with typical hearing and with cochlear implants

A New Development in Tone and Intonation Study——PENTA Model

Effects of native language experience on Mandarin lexical tone processing in proficient second language learners.

What can tone studies tell us about intonation

An OT Account of the Second Language Acquisition of Mandarin Tone Pairs