Abstract:Comprehending speech requires deciphering a range of linguistic representations, from phonemes to narratives. Prior research suggests that in single-talker scenarios, the neural encoding of linguistic units follows a hierarchy of increasing temporal receptive windows. Shorter temporal units like phonemes and syllables are encoded by lower-level sensory brain regions, whereas longer units such as sentences and paragraphs are processed by higher-level perceptual and cognitive areas. However, the brain's representation of these linguistic units under challenging listening conditions, such as a cocktail party situation, remains unclear. In this study, we recorded electroencephalogram (EEG) responses from both normal-hearing and hearing-impaired participants as they listened to individual and dual speakers narrating different parts of a story. The inclusion of hearing-impaired listeners allowed us to examine how hierarchically organized linguistic units in competing speech streams affect comprehension abilities. We leveraged a hierarchical language model to extract linguistic information at multiple levels--phoneme, syllable, word, phrase, and sentence--and aligned these model activations with the EEG data. Our findings showed distinct neural responses to dual-speaker speech between the two groups. Specifically, compared to normal-hearing listeners, hearing-impaired listeners exhibited poorer model fits at the acoustic, phoneme, and syllable levels as well as the sentence levels, but not at the word and phrase levels. These results suggest that hearing-impaired listeners experience disruptions at both shorter and longer temporal scales, while their processing at medium temporal scales remains unaffected.

Short-term Memory and Listening Comprehension

Auditory Short-Term Memory, Listening Comprehension, and the Input Hypothesis

Neural Substrate Underlying the Learning of a Passage with Unfamiliar Vocabulary and Syntax.

A Review of Studies on the Mechanism of Memory in Language Comprehension

STUDY ON THE RELATIONSHIP BETWEEN WORKING MEMORY AND EFL LISTENING COMPREHENSION

The Relationship Between Working Memory and Reading Comprehension and Its Implications for Teaching of Reading

Under the Perspective of Cognitive Linguistics to English Listening Discourse Comprehension

The role of key visuals in reducing working memory load during L2 listening comprehension

The role of short-term memory in discourse comprehension: some reflections on the impact of Kintsch and van Dijk (1978)

Assessing Second Language Listening over the Past Twenty Years: A Review Within the Socio-Cognitive Framework

Reexamining the relationship between working memory and comprehension: The role of available long-term memory

The Effects of Discourse Markers on Listening Comprehension

Factors Affecting Listening Comprehension and Strategies

A Cognitive Study of Listening Comprehension and Its Application in Language Teaching

On Factors Affecting FL Listening Comprehension

Cognitive Context and Teaching Chinese Listening to Foreigners

Working Memory Ability and Second Language Input Learning

Fine-structure Storage, Correlation Computation, Attribute Capture, Perceptual Integration, and Perceived Spatial Separation: an Auditory Chain in the Reverberant Environment

Multi-talker speech comprehension at different temporal scales in listeners with normal and impaired hearing

Listening to two-talker conversations in quiet settings: the role of listeners' cognitive processing capabilities for memory and listening effort

The Effect of Hearing Loss and Working Memory Capacity on Context Use and Reliance on Context in Older Adults