Abstract:Speech comprehension requires the human brain to transform an acoustic waveform into meaning. To do so, the brain generates a hierarchy of features that converts the sensory input into increasingly abstract language properties. However, little is known about how these hierarchical features are generated and continuously coordinated. Here, we propose that each linguistic feature is dynamically represented in the brain to simultaneously represent successive events. To test this ‘Hierarchical Dynamic Coding’ (HDC) hypothesis, we use time-resolved decoding of brain activity to track the construction, maintenance, and integration of a comprehensive hierarchy of language features spanning acoustic, phonetic, sub-lexical, lexical, syntactic and semantic representations. For this, we recorded 21 participants with magnetoencephalography (MEG), while they listened to two hours of short stories. Our analyses reveal three main findings. First, the brain incrementally represents and simultaneously maintains successive features. Second, the duration of these representations depend on their level in the language hierarchy. Third, each representation is maintained by a dynamic neural code, which evolves at a speed commensurate with its corresponding linguistic level. This HDC preserves the maintenance of information over time while limiting the interference between successive features. Overall, HDC reveals how the human brain continuously builds and maintains a language hierarchy during natural speech comprehension, thereby anchoring linguistic theories to their biological implementations.

Cortical tracking of hierarchical linguistic structures in connected speech

The Cortical Maps of Hierarchical Linguistic Structures During Speech Perception

Cortical Tracking of Constituent Structure in Language Acquisition

Delta-band Cortical Tracking of Acoustic and Linguistic Features in Natural Spoken Narratives

The Influence of Linguistic Information on Cortical Tracking of Words

Cortical encoding of acoustic and linguistic rhythms in spoken narratives

Time-domain Analysis of Neural Tracking of Hierarchical Linguistic Structures

Low-frequency Cortical Activity Reflects Context-dependent Parsing of Word Sequences

[The Neural Encoding of Continuous Speech - Recent Advances in EEG and MEG Studies].

Delta-band Neural Activity Primarily Tracks Sentences Instead of Semantic Properties of Words

Rule-Based and Word-Level Statistics-Based Processing of Language: Insights from Neuroscience

Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “cocktail Party”

Elife Assessment: Finding Structure During Incremental Speech Comprehension

Cortical tracking of language structures: Modality-dependent and independent responses

Characterizing Neural Entrainment to Hierarchical Linguistic Units using Electroencephalography (EEG).

Neural Signatures of Hierarchical Linguistic Structures in Second Language Listening Comprehension

Neural Tracking to Auditory Statistical Structures in Children

Hierarchical dynamic coding coordinates speech comprehension in the brain

Cortical encoding of hierarchical linguistic information when syllabic rhythms are obscured by echoes

Complex Mapping between Neural Response Frequency and Linguistic Units in Natural Speech

The cortical representation of language timescales is shared between reading and listening