Abstract:Human listeners can reliably recognize speech in complex listening environments. The underlying neural mechanisms, however, remain unclear and cannot yet be emulated by any artificial system. In this dissertation, we study how speech is represented in the human auditory cortex and how the neural representation contributes to reliable speech recognition. Cortical activity from normal hearing human subjects is noninvasively recorded using magnetoencephalography, during natural speech listening. It is first demonstrated that neural activity from auditory cortex is precisely synchronized to the slow temporal modulations of speech, when the speech signal is presented in a quiet listening environment. How this neural representation is affected by acoustic interference is then investigated. Acoustic interference degrades speech perception via two mechanisms, informational masking and energetic masking, which are addressed respectively by using a competing speech stream and a stationary noise as the interfering sound. When two speech streams are presented simultaneously, cortical activity is predominantly synchronized to the speech stream the listener attends to, even if the unattended, competing speech stream is 8 dB more intense. When speech is presented together with spectrally matched stationary noise, cortical activity remains precisely synchronized to the temporal modulations of speech until the noise is 9 dB more intense. Critically, the accuracy of neural synchronization to speech predicts how well individual listeners can understand speech in noise. Further analysis reveals that two neural sources contribute to speech synchronized cortical activity, one with a shorter response latency of about 50 ms and the other with a longer response latency of about 100 ms. The longer-latency component, but not the shorter-latency component, shows selectivity to the attended speech and invariance to background noise, indicating a transition from encoding the acoustic scene to encoding the behaviorally important auditory object, in auditory cortex. Taken together, we have demonstrated that during natural speech comprehension, neural activity in the human auditory cortex is precisely synchronized to the slow temporal modulations of speech. This neural synchronization is robust to acoustic interference, whether speech or noise, and therefore provides a strong candidate for the neural basis of acoustic background invariant speech recognition.

Dynamic encoding of phonetic categories in zebra finch auditory forebrain

Temporal coding of speech in human auditory cortex

Cortical Neural Coding of Speech in Simple and Complex Auditory Scenes.

Rapid and long-lasting improvements in neural discrimination of acoustic signals with passive familiarization

Auditory processing in the zebra finch midbrain: single unit responses and effect of rearing experience

A songbird forebrain area potentially involved in auditory discrimination and memory formation

[Lateral Differences in the Forebrain and Midbrain Control of Learned Vocalizations in Adult Male Zebra Finch (taeniopygia Guttata)].

Categorical and semantic perception of the meaning of call-types in zebra finches

A complex acoustical environment during development enhances auditory perception and coding efficiency in the zebra finch

Human-like brain hemispheric dominance in birdsong learning

Neural dynamics underlying the acquisition of distinct auditory category structures

Neural correlates of vocal initiation in the VTA/SNc of juvenile male zebra finches

Auditory discrimination learning and acoustic cue weighing in female zebra finches with localised FoxP1 knockdowns

Social and auditory experience shapes forebrain responsiveness in zebra finches before the sensitive period of vocal learning

Early Auditory Experience Modifies Neuronal Firing Properties in the Zebra Finch Auditory Cortex

Systematic changes in neural selectivity reflect the acquired salience of category-diagnostic dimensions

Neural correlates of phonetic categorization under auditory (phoneme) and visual (grapheme) modalities

High-capacity auditory memory for vocal communication in a social songbird

Song Processing in the Zebra Finch Auditory Forebrain Reflects Asymmetric Sensitivity to Temporal and Spectral Structure

High responsiveness of auditory neurons to specific combination of acoustic features in female songbirds

Learning-related brain hemispheric dominance in sleeping songbirds