Abstract:The generation of hierarchical structures is central to language, music and complex action. Understanding this capacity and its potential impairments requires mapping its underlying cognitive processes to the respective neuronal underpinnings. In language, left inferior frontal gyrus and left posterior temporal cortex (superior temporal sulcus/middle temporal gyrus) are considered hubs for syntactic processing. However, it is unclear whether these regions support computations specific to language or more generally support analyses of hierarchical structure. Here, we address this issue by investigating hierarchical processing in a non-linguistic task. We test the ability to represent recursive hierarchical embedding in the visual domain by contrasting a recursion task with an iteration task. The recursion task requires participants to correctly identify continuations of a hierarchy generating procedure, while the iteration task applies a serial procedure that does not generate new hierarchical levels. In a lesion-based approach, we asked 44 patients with left hemispheric chronic brain lesion to perform recursion and iteration tasks. We modelled accuracies and response times with a drift diffusion model and for each participant obtained parametric estimates for the velocity of information accumulation (drift rates) and for the amount of information accumulated before a decision (boundary separation). We then used these estimates in lesion-behaviour analyses to investigate how brain lesions affect specific aspects of recursive hierarchical embedding. We found that lesions in the posterior temporal cortex decreased drift rate in recursive hierarchical embedding, suggesting an impaired process of rule extraction from recursive structures. Moreover, lesions in inferior temporal gyrus decreased boundary separation. The latter finding does not survive conservative correction but suggests a shift in the decision criterion. As patients also participated in a grammar comprehension experiment, we performed explorative correlation-analyses and found that visual and linguistic recursive hierarchical embedding accuracies are correlated when the latter is instantiated as sentences with two nested embedding levels. While the roles of the inferior temporal gyrus and posterior temporal cortex in linguistic processes are well established, here we show that posterior temporal cortex lesions slow information accumulation (drift rate) in the visual domain. This suggests that posterior temporal cortex is essential to acquire the (knowledge) representations necessary to parse recursive hierarchical embedding in visual structures, a finding mimicking language acquisition in young children. On the contrary, inferior frontal gyrus lesions seem to affect recursive hierarchical embedding processing by interfering with more general cognitive control (boundary separation). This interesting separation of roles, rooted on a domain-general taxonomy, raises the question of whether such cognitive framing is also applicable to other domains.

Disruption of Broca's Area Alters Higher-order Chunking Processing during Perceptual Sequence Learning

Asymmetrical sequence chunking for auditory and visual domains in the left and right hemispheres

Chunk-Based Sequence Representation in the Human Brain

The Cortical Maps of Hierarchical Linguistic Structures During Speech Perception

Broca's Area in Language, Action, and Music

Brain-imaging evidence for compression of binary sound sequences in human memory

Recursive hierarchical embedding in vision is impaired by posterior middle temporal gyrus lesions

Broca's area processes the hierarchical organization of observed action

Language and action in Broca’s area: Computational differentiation and cortical segregation

Towards a causal role of Broca’s area in language: A TMS-EEG study on syntactic prediction

The language skeleton after dissecting meaning: A functional segregation within Broca's Area

Neurological basis of language and sequential cognition: Evidence from simulation, aphasia, and ERP studies

The capacity of the medial temporal lobe to represent memory items in their ordinal position in a sequence is domain-general

Low-frequency neural activity reflects rule-based chunking during speech listening

Different subregions of monkey lateral prefrontal cortex respond to abstract sequences and their components

Oscillatory EEG dynamics underlying automatic chunking during sentence processing

Cortical-subcortical interactions underlie processing of auditory predictions measured with 7T fMRI

What artificial grammar learning reveals about the neurobiology of syntax

Chunking improves symbolic sequence processing and relies on working memory gating mechanisms

Chunk Duration Limits the Learning of Multiword Chunks: Behavioral and Electroencephalogram Evidence from Statistical Learning

Music and Language Syntax Interact in Broca’s Area: An fMRI Study