Abstract:Human listeners can reliably recognize speech in complex listening environments. The underlying neural mechanisms, however, remain unclear and cannot yet be emulated by any artificial system. In this dissertation, we study how speech is represented in the human auditory cortex and how the neural representation contributes to reliable speech recognition. Cortical activity from normal hearing human subjects is noninvasively recorded using magnetoencephalography, during natural speech listening. It is first demonstrated that neural activity from auditory cortex is precisely synchronized to the slow temporal modulations of speech, when the speech signal is presented in a quiet listening environment. How this neural representation is affected by acoustic interference is then investigated. Acoustic interference degrades speech perception via two mechanisms, informational masking and energetic masking, which are addressed respectively by using a competing speech stream and a stationary noise as the interfering sound. When two speech streams are presented simultaneously, cortical activity is predominantly synchronized to the speech stream the listener attends to, even if the unattended, competing speech stream is 8 dB more intense. When speech is presented together with spectrally matched stationary noise, cortical activity remains precisely synchronized to the temporal modulations of speech until the noise is 9 dB more intense. Critically, the accuracy of neural synchronization to speech predicts how well individual listeners can understand speech in noise. Further analysis reveals that two neural sources contribute to speech synchronized cortical activity, one with a shorter response latency of about 50 ms and the other with a longer response latency of about 100 ms. The longer-latency component, but not the shorter-latency component, shows selectivity to the attended speech and invariance to background noise, indicating a transition from encoding the acoustic scene to encoding the behaviorally important auditory object, in auditory cortex. Taken together, we have demonstrated that during natural speech comprehension, neural activity in the human auditory cortex is precisely synchronized to the slow temporal modulations of speech. This neural synchronization is robust to acoustic interference, whether speech or noise, and therefore provides a strong candidate for the neural basis of acoustic background invariant speech recognition.

Neural Representation of Interaural Correlation in Human Auditory Brainstem: Comparisons Between Temporal-Fine Structure and Envelope.

Neural representations of complex temporal modulations in the human auditory cortex.

Temporal coding of speech in human auditory cortex

Neural Representations of Concurrent Sounds with Overlapping Spectra in Rat Inferior Colliculus: Comparisons Between Temporal-Fine Structure and Envelope.

Auditory Midbrain Representation Of A Break In Interaural Correlation

Different Binaural Processing of the Envelope Component and the Temporal Fine Structure Component of a Narrowband Noise in Rat Inferior Colliculus

Binaural Unmasking of the Accuracy of Envelope-Signal Representation in Rat Auditory Cortex but Not Auditory Midbrain

Dynamic Binaural-Correlation Processing in Rats' Inferior Colliculus, Medial Geniculate Body, and Primary Auditory Cortex

Detection and Cortical Representations of the Break in Interaural Correlation of Narrowband Noises Are Affected by Center Frequency and Interaural Delay

Evidence of Neural Processing of the Interaural Correlation Between Long-Duration Noises in Humans

Sensitivity to Interaural Time Differences Conveyed in the Stimulus Envelope: Estimating Inputs of Binaural Neurons Through the Temporal Analysis of Spike Trains

Disparity in Interaural Time Difference Improves the Accuracy of Neural Representations of Concurrent Sounds in Rat Inferior Colliculus and Auditory Cortex.

Modelling Envelope and Temporal Fine Structure Components of Frequency-Following Responses in Rat Inferior Colliculus

Two crossed axonal projections contribute to binaural unmasking of frequency-following responses in rat inferior colliculus.

Dynamic Correlations Between Intrinsic Connectivity and Extrinsic Connectivity of the Auditory Cortex in Humans

Neural encoding for spatial release from informational masking and its correlation with behavioral metrics

The neural representation of an auditory spatial cue in the primate cortex

Response and noise correlations to complex natural sounds in the auditory midbrain

Neural Correlates of Temporal Complexity and Synchrony During Audiovisual Correspondence Detection

A Computational Model for Evaluating Transient Auditory Storage of Acoustic Features in Normal Listeners

Differences Between Auditory Frequency-Following Responses and Onset Responses: Intracranial Evidence from Rat Inferior Colliculus