Abstract:In recent years, it has become clear that EEG indexes the comprehension of natural, narrative speech. One particularly compelling demonstration of this fact can be seen by regressing EEG responses to speech against measures of how individual words in that speech linguistically relate to their preceding context. This approach produces a so-called temporal response function that displays a centro-parietal negativity reminiscent of the classic N400 component of the event-related potential. One shortcoming of previous implementations of this approach is that they have typically assumed a linear, time-invariant relationship between the linguistic speech features and the EEG responses. In other words, the analysis typically assumes that the response has the same shape and timing for every word - and only varies (linearly) in terms of its amplitude. In the present work, we relax this assumption under the hypothesis that responses to individual words may be processed more rapidly when they are predictable. Specifically, we introduce a framework wherein the standard linear temporal response function can be modulated in terms of its amplitude, latency, and temporal scale based on the expectedness of the current and prior words. We use the proposed approach to model EEG recorded from a set of participants who listened to an audiobook narrated by a single talker, and a separate set of participants who attended to one of two concurrently presented audiobooks. We show that expected words are processed faster - evoking lower amplitude N400-like responses with earlier peaks - and that this effect is driven both by the word's own predictability and the predictability of the immediately preceding word. Additional analysis suggests that this finding is not simply explained based on how quickly words can be disambiguated from their phonetic neighbors. As such, our study demonstrates that the timing and amplitude of brain responses to words in natural speech depend on their predictability. By accounting for these effects, our framework also improves the accuracy with which neural responses to natural speech can be modeled.

The Same Ultra-Rapid Parallel Brain Dynamics Underpin the Production and Perception of Speech

Chunk-Based Sequence Representation in the Human Brain

The Cortical Maps of Hierarchical Linguistic Structures During Speech Perception

Cortical encoding of acoustic and linguistic rhythms in spoken narratives

Parallel or sequential? Decoding conceptual and phonological/phonetic information from MEG signals during language production

Congruent brain signatures specific to phonology in fronto-temporal cortex during language production and understanding.

Revealing Spatiotemporal Brain Dynamics Of Speech Production Based On Eeg And Eye Movement

Whole-brain dynamics of articulatory, acoustic and semantic speech representations

Parallel Processing of Semantics and Phonology in Spoken Production: Evidence from Blocked Cyclic Picture Naming and EEG

Network dynamics of Broca’s area during word selection

Unraveling Predictive Mechanism in Speech Perception and Production: Insights from EEG Analyses of Brain Network Dynamics

Spatio-Temporal Progression of Cortical Activity Related to Continuous Overt and Covert Speech Production in a Reading Task

Single-neuronal elements of speech production in humans

Hearing what is being said: The distributed neural substrate for early speech interpretation

Dynamic modeling of EEG responses to natural speech reveals earlier processing of predictable words

The neural dynamics of auditory word recognition and integration

From single words to sentence production: Shared cortical representations but distinct temporal dynamics

Modulation of brain activity by psycholinguistic information during naturalistic speech comprehension and production

Intracranial Mapping of Response Latencies and Task Effects for Spoken Syllable Processing in the Human Brain

Parallel Encoding of Speech in Human Frontal and Temporal Lobes

Analyzing Differences in Processing Nouns and Verbs in the Human Brain using Combined EEG and MEG Measurements