Abstract:The brain's circuitry for perceiving and producing speech may show a notable level of overlap that is crucial for normal development and behavior. The extent to which sensorimotor integration plays a role in speech perception remains highly controversial, however. Methodological constraints related to experimental designs and analysis methods have so far prevented the disentanglement of neural responses to acoustic versus articulatory speech features. Using a passive listening paradigm and multivariate decoding of single-trial fMRI responses to spoken syllables, we investigated brain-based generalization of articulatory features (place and manner of articulation, and voicing) beyond their acoustic (surface) form in adult human listeners. For example, we trained a classifier to discriminate place of articulation within stop syllables (e.g., /pa/ vs /ta/) and tested whether this training generalizes to fricatives (e.g., /fa/ vs /sa/). This novel approach revealed generalization of place and manner of articulation at multiple cortical levels within the dorsal auditory pathway, including auditory, sensorimotor, motor, and somatosensory regions, suggesting the representation of sensorimotor information. Additionally, generalization of voicing included the right anterior superior temporal sulcus associated with the perception of human voices as well as somatosensory regions bilaterally. Our findings highlight the close connection between brain systems for speech perception and production, and in particular, indicate the availability of articulatory codes during passive speech perception.SIGNIFICANCE STATEMENT: Sensorimotor integration is central to verbal communication and provides a link between auditory signals of speech perception and motor programs of speech production. It remains highly controversial, however, to what extent the brain's speech perception system actively uses articulatory (motor), in addition to acoustic/phonetic, representations. In this study, we examine the role of articulatory representations during passive listening using carefully controlled stimuli (spoken syllables) in combination with multivariate fMRI decoding. Our approach enabled us to disentangle brain responses to acoustic and articulatory speech properties. In particular, it revealed articulatory-specific brain responses of speech at multiple cortical levels, including auditory, sensorimotor, and motor regions, suggesting the representation of sensorimotor information during passive speech perception.

An Examination of the Articulatory Characteristics of Prominence in Function and Content Words Using Real-Time Magnetic Resonance Imaging

The Effect of Word Frequency and Lexical Class on Articulatory-Acoustic Coupling

Cortical encoding of acoustic and linguistic rhythms in spoken narratives

Effects of Mandarin Tones on Acoustic Cue Weighting Patterns for Prominence.

Interaction of Jaw Displacement and F0 Peak in Syllables Produced with Contrastive Emphasis

An Acoustic Measure for Word Prominence in Spontaneous Speech

Phonology, phonetics, and signal-extrinsic factors in the perception of prosodic prominence: Evidence from Rapid Prosody Transcription

Testing Native Language Neural Commitment at the Brainstem Level: A Cross-Linguistic Investigation of the Association Between Frequency-Following Response and Speech Perception.

Contribution of acoustic cues to prominence ratings for four Mandarin vowels

The supralaryngeal articulation of stress and accent in Greek

Auditory-Articulatory Neural Alignment Between Listener and Speaker During Verbal Communication.

Phonetic Realization of Contrastive Focus in Korean

Fmri Evidence for the Automatic Phonological Activation of Briefly Presented Words

A fMRI Study of Auditory Phonologic Attention

The Acoustic Effect of Speaking Rate, Focus and Prosodic Position on Syllables in Chinese

Syllabic Tone Articulation Influences the Identification and Use of Words During Chinese Sentence Reading: Evidence from ERP and Eye Movement Recordings.

Integrating phonetics and phonology in the study of linguistic prominence

Decoding Articulatory Features from fMRI Responses in Dorsal Speech Regions

Time-varying acoustic and articulatory characteristics of American English [ɹ]: a cross-speaker study

An Mri-Based Acoustic Study Of Mandarin Vowels

Attentional and linguistic interactions in speech perception