Abstract:The brain's circuitry for perceiving and producing speech may show a notable level of overlap that is crucial for normal development and behavior. The extent to which sensorimotor integration plays a role in speech perception remains highly controversial, however. Methodological constraints related to experimental designs and analysis methods have so far prevented the disentanglement of neural responses to acoustic versus articulatory speech features. Using a passive listening paradigm and multivariate decoding of single-trial fMRI responses to spoken syllables, we investigated brain-based generalization of articulatory features (place and manner of articulation, and voicing) beyond their acoustic (surface) form in adult human listeners. For example, we trained a classifier to discriminate place of articulation within stop syllables (e.g., /pa/ vs /ta/) and tested whether this training generalizes to fricatives (e.g., /fa/ vs /sa/). This novel approach revealed generalization of place and manner of articulation at multiple cortical levels within the dorsal auditory pathway, including auditory, sensorimotor, motor, and somatosensory regions, suggesting the representation of sensorimotor information. Additionally, generalization of voicing included the right anterior superior temporal sulcus associated with the perception of human voices as well as somatosensory regions bilaterally. Our findings highlight the close connection between brain systems for speech perception and production, and in particular, indicate the availability of articulatory codes during passive speech perception.SIGNIFICANCE STATEMENT: Sensorimotor integration is central to verbal communication and provides a link between auditory signals of speech perception and motor programs of speech production. It remains highly controversial, however, to what extent the brain's speech perception system actively uses articulatory (motor), in addition to acoustic/phonetic, representations. In this study, we examine the role of articulatory representations during passive listening using carefully controlled stimuli (spoken syllables) in combination with multivariate fMRI decoding. Our approach enabled us to disentangle brain responses to acoustic and articulatory speech properties. In particular, it revealed articulatory-specific brain responses of speech at multiple cortical levels, including auditory, sensorimotor, and motor regions, suggesting the representation of sensorimotor information during passive speech perception.

Ultraviolet irradiation of murine skin alters cluster formation between lymph node dendritic cells and specific T lymphocytes.

Speech neuromuscular decoding based on spectrogram images using conformal predictors with Bi-LSTM.

Text-driven Visual Prosody Generation for Embodied Conversational Agents

An articulatory model of standard Chinese using MRI and X-ray movie

Simulating Articulatory Trajectories with Phonological Feature Interpolation

Coding Speech through Vocal Tract Kinematics

Target-filtering model based articulatory movement prediction for articulatory control of HMM-based speech synthesis

Towards a Quantitative Analysis of Coarticulation with a Phoneme-to-Articulatory Model

Decoding and synthesizing tonal language speech from brain activity

A Speech-Driven 3-D Tongue Model with Realistic Movement in Mandarin Chinese.

Coupling Phonology and Phonetics in a Constraint-Based Gestural Model

Speech Reconstruction from Silent Lip and Tongue Articulation by Diffusion Models and Text-Guided Pseudo Target Generation

Significant enhancement of room temperature ferromagnetism in surfactant coated polycrystalline Mn doped ZnO particles

On the Emergence of Phonological Knowledge and on Motor Planning and Motor Programming in a Developmental Model of Speech Production

Linguistic modulation of the neural encoding of phonemes

Decoding Articulatory Features from fMRI Responses in Dorsal Speech Regions

Tongue Shape Variation Model for Simulating Mandarin Chinese Articulation.

Speaker- and Text-Independent Estimation of Articulatory Movements and Phoneme Alignments from Speech

Inverse Biomechanical Modeling of the Tongue via Machine Learning and Synthetic Training Data

Tongue Postures and Tongue Centers: A Study of Acoustic-Articulatory Correspondences Across Different Head Angles

Synthesizing audio from tongue motion during speech using tagged MRI via transformer