Abstract:The extent to which the sleeping brain processes sensory information remains unclear. This is particularly true for continuous and complex stimuli such as speech, in which information is organized into hierarchically embedded structures. Recently, novel metrics for assessing the neural representation of continuous speech have been developed using noninvasive brain recordings that have thus far only been tested during wakefulness. Here we investigated, for the first time, the sleeping brain's capacity to process continuous speech at different hierarchical levels using a newly developed Concurrent Hierarchical Tracking (CHT) approach that allows monitoring the neural representation and processing-depth of continuous speech online. Speech sequences were compiled with syllables, words, phrases, and sentences occurring at fixed time intervals such that different linguistic levels correspond to distinct frequencies. This enabled us to distinguish their neural signatures in brain activity. We compared the neural tracking of intelligible versus unintelligible (scrambled and foreign) speech across states of wakefulness and sleep using high-density EEG in humans. We found that neural tracking of stimulus acoustics was comparable across wakefulness and sleep and similar across all conditions regardless of speech intelligibility. In contrast, neural tracking of higher-order linguistic constructs (words, phrases, and sentences) was only observed for intelligible speech during wakefulness and could not be detected at all during nonrapid eye movement or rapid eye movement sleep. These results suggest that, whereas low-level auditory processing is relatively preserved during sleep, higher-level hierarchical linguistic parsing is severely disrupted, thereby revealing the capacity and limits of language processing during sleep.SIGNIFICANCE STATEMENT Despite the persistence of some sensory processing during sleep, it is unclear whether high-level cognitive processes such as speech parsing are also preserved. We used a novel approach for studying the depth of speech processing across wakefulness and sleep while tracking neuronal activity with EEG. We found that responses to the auditory sound stream remained intact; however, the sleeping brain did not show signs of hierarchical parsing of the continuous stream of syllables into words, phrases, and sentences. The results suggest that sleep imposes a functional barrier between basic sensory processing and high-level cognitive processing. This paradigm also holds promise for studying residual cognitive abilities in a wide array of unresponsive states.

Brainstem speech encoding is dynamically shaped online by fluctuations in cortical α state

Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech

Temporal coding of speech in human auditory cortex

Robust cortical encoding of slow temporal modulations of speech.

Cortical entrainment to continuous speech: functional roles and interpretations.

Sleep Disrupts High-Level Speech Parsing Despite Significant Basic Auditory Processing

Cortical Neural Coding of Speech in Simple and Complex Auditory Scenes.

Cortical encoding of acoustic and linguistic rhythms in spoken narratives

Decoding of selective attention to continuous speech from the human auditory brainstem response

Auditory brainstem responses to speech-in-noise reflect selective attention, comprehension, and subjective listening effort

Selective attention and brainstem frequency-following responses

Selective Attention Modulates Human Auditory Brainstem Responses: Relative Contributions of Frequency and Spatial Cues

Opposing neural processing modes alternate rhythmically during sustained auditory attention

Brain network interconnectivity dynamics explain metacognitive differences in listening behavior

Subcortical responses to music and speech are alike while cortical responses diverge

Dynamic oscillatory processes governing cued orienting and allocation of auditory attention

Cortical Oscillations In Auditory Perception And Speech: Evidence For Two Temporal Windows In Human Auditory Cortex

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Testing Native Language Neural Commitment at the Brainstem Level: A Cross-Linguistic Investigation of the Association Between Frequency-Following Response and Speech Perception.

Cortical Dynamics of Acoustic and Phonological Processing in Speech Perception

Selective attention to audiovisual speech routes activity through recurrent feedback-feedforward loops between different nodes of the speech network