Abstract:This study investigated the nature of the underlying working memory system supporting sentence processing through examining individual differences in sensitivity to retrieval interference effects during sentence comprehension. Interference effects occur when readers incorrectly retrieve sentence constituents which are similar to those required during integrative processes. We examined interference arising from a partial match between distracting constituents and syntactic and semantic cues, and related these interference effects to performance on working memory, short-term memory (STM), vocabulary, and executive function tasks. For online sentence comprehension, as measured by self-paced reading, the magnitude of individuals' syntactic interference effects was predicted by general WM capacity and the relation remained significant when partialling out vocabulary, indicating that the effects were not due to verbal knowledge. For offline sentence comprehension, as measured by responses to comprehension questions, both general WM capacity and vocabulary knowledge interacted with semantic interference for comprehension accuracy, suggesting that both general WM capacity and the quality of semantic representations played a role in determining how well interference was resolved offline. For comprehension question reaction times, a measure of semantic STM capacity interacted with semantic but not syntactic interference. However, a measure of phonological capacity (digit span) and a general measure of resistance to response interference (Stroop effect) did not predict individuals' interference resolution abilities in either online or offline sentence comprehension. The results are discussed in relation to the multiple capacities account of working memory (e.g., Martin and Romani, 1994; Martin and He, 2004), and the cue-based retrieval parsing approach (e.g., Lewis et al., 2006; Van Dyke et al., 2014). While neither approach was fully supported, a possible means of reconciling the two approaches and directions for future research are proposed.

A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing

Schrodinger's Memory: Large Language Models

Meta predictive learning model of languages in neural circuits

Semantic and Syntactic Interference in Sentence Comprehension: A Comparison of Working Memory Models

A resource-rational model of human processing of recursive linguistic structure

Context Limitations Make Neural Language Models More Human-Like

Towards Interpreting Language Models: A Case Study in Multi-Hop Reasoning

Memory Augmented Large Language Models are Computationally Universal

RECURRENT NEURAL NETWORK BASED LANGUAGE MODELING WITH CONTROLLABLE EXTERNAL MEMORY

Human Cognition and Language Processing with Neural-Lexicon Hypothesis

A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans

Brain-Like Language Processing via a Shallow Untrained Multihead Attention Network

Associative memory inspires improvements for in-context learning using a novel attention residual stream architecture

Towards a Psychology of Machines: Large Language Models Predict Human Memory

Conceptual structure coheres in human cognition but not in large language models

Linking In-context Learning in Transformers to Human Episodic Memory

Self-Attention Limits Working Memory Capacity of Transformer-Based Models

Too Big to Fail: Larger Language Models are Disproportionately Resilient to Induction of Dementia-Related Linguistic Anomalies

On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior

Lossy‐Context Surprisal: An Information‐Theoretic Model of Memory Effects in Sentence Processing