Abstract:Human listeners can reliably recognize speech in complex listening environments. The underlying neural mechanisms, however, remain unclear and cannot yet be emulated by any artificial system. In this dissertation, we study how speech is represented in the human auditory cortex and how the neural representation contributes to reliable speech recognition. Cortical activity from normal hearing human subjects is noninvasively recorded using magnetoencephalography, during natural speech listening. It is first demonstrated that neural activity from auditory cortex is precisely synchronized to the slow temporal modulations of speech, when the speech signal is presented in a quiet listening environment. How this neural representation is affected by acoustic interference is then investigated. Acoustic interference degrades speech perception via two mechanisms, informational masking and energetic masking, which are addressed respectively by using a competing speech stream and a stationary noise as the interfering sound. When two speech streams are presented simultaneously, cortical activity is predominantly synchronized to the speech stream the listener attends to, even if the unattended, competing speech stream is 8 dB more intense. When speech is presented together with spectrally matched stationary noise, cortical activity remains precisely synchronized to the temporal modulations of speech until the noise is 9 dB more intense. Critically, the accuracy of neural synchronization to speech predicts how well individual listeners can understand speech in noise. Further analysis reveals that two neural sources contribute to speech synchronized cortical activity, one with a shorter response latency of about 50 ms and the other with a longer response latency of about 100 ms. The longer-latency component, but not the shorter-latency component, shows selectivity to the attended speech and invariance to background noise, indicating a transition from encoding the acoustic scene to encoding the behaviorally important auditory object, in auditory cortex. Taken together, we have demonstrated that during natural speech comprehension, neural activity in the human auditory cortex is precisely synchronized to the slow temporal modulations of speech. This neural synchronization is robust to acoustic interference, whether speech or noise, and therefore provides a strong candidate for the neural basis of acoustic background invariant speech recognition.

Parallel Processing of Sound Dynamics Across Mouse Auditory Cortex Via Spatially Patterned Thalamic Inputs and Distinct Areal Intracortical Circuits

Temporal coding of speech in human auditory cortex

Spatial organization of the mouse auditory cortex to sound dynamics revealed using automated image segmentation

Sparse representation of neurons for encoding complex sounds in the auditory cortex

Recurrent connectivity underlies lateralized temporal processing differences in Auditory Cortex

Transient Subgranular Hyperconnectivity to L2/3 and Enhanced Pairwise Correlations During the Critical Period in the Mouse Auditory Cortex.

Modulation of auditory responses by visual inputs in the mouse auditory cortex

Cortical Oscillations In Auditory Perception And Speech: Evidence For Two Temporal Windows In Human Auditory Cortex

Spatiotemporal Mapping of Auditory Onsets during Speech Production

Mixed Representations of Sound and Action in the Auditory Midbrain

Auditory Thalamostriatal and Corticostriatal Pathways Convey Complementary Information about Sound Features

Hierarchical Deviant Processing in Auditory Cortex of Awake Mice

Columnar and layer-specific representation of spatial sensitivity in mouse primary auditory cortex.

Diversity Of Receptive Fields And Sideband Inhibition With Complex Thalamocortical And Intracortical Origin In L2/3 Of Mouse Primary Auditory Cortex

Microprism-based two-photon imaging of the lateral cortex of the mouse inferior colliculus reveals novel organizational principles of the auditory midbrain

Experience-dependent coding of frequency-modulated trajectories by offsets in auditory cortex

Spectral and Temporal Integration in the Auditory Cortex of Alert Primates

BOLD-fMRI in the mouse auditory pathway

Cell-specific activity-dependent fractionation of layer 2/3→5B excitatory signaling in mouse auditory cortex

Dynamic Correlations Between Intrinsic Connectivity and Extrinsic Connectivity of the Auditory Cortex in Humans

Cortical Dynamics of Acoustic and Phonological Processing in Speech Perception