Abstract:The integral capacity of human language together with semantic memory drives the linkage of words and their meaning, which theoretically is subject to cognitive control. However, it remains unknown whether, across different language modalities and input/output formats, there is a shared system in the human brain for word-meaning binding and how this system interacts with cognitive control. Here, we conducted a functional magnetic resonance imaging experiment based on a large cohort of subjects (50 females, 50 males) to comprehensively measure the brain responses evoked by semantic processing in spoken and written word comprehension and production tasks (listening, speaking, reading, and writing). We found that heteromodal word input and output tasks involved distributed brain regions within a frontal-parietal-temporal network and focally coactivated the anterior lateral visual word form area (VWFA), which is located in the basal occipitotemporal area. Directed connectivity analysis revealed that the VWFA was invariably under significant top-down modulation of the frontoparietal control network and interacts with regions related to attention and semantic representation. This study reveals that the VWFA is a key site subserving general semantic processes linking words and meaning, challenging the predominant emphasis on this area's specific role in reading or more general visual processes. Our findings also suggest that the dynamics between semantic memory and cognitive control mechanisms during word processing are largely independent of the modalities of input or output.SIGNIFICANCE STATEMENT Binding words and their meaning into a coherent whole during retrieval requires accessing semantic memory and cognitive control, allowing our thoughts to be expressed and comprehended through mind-external tokens in multiple modalities, such as written or spoken forms. However, it is still unknown whether multimodal language comprehension and production share a common word-meaning binding system in human brains and how this system is connected to a cognitive control mechanism. By systematically measuring brain activity evoked by spoken and written verbal input and output tasks tagging word-meaning binding processes, we demonstrate a general word-meaning binding site within the visual word form area (VWFA) and how this site is modulated by the frontal-parietal control network.

Processing demands modulate the activities and functional connectivity patterns of the posterior (VWFA-1) and anterior (VWFA-2) VWFA

Resting state neural networks for visual Chinese word processing in Chinese adults and children.

The visual word form area (VWFA) is part of both language and attention circuitry

Higher Functional Connectivity of Ventral Attention and Visual Network to Maintain Cognitive Performance in White Matter Hyperintensity.

Dissociated roles of the parietal and frontal cortices in the scope and control of attention during visual working memory.

The Differences of Visual Word Form Processing Mechanism Between Chinese and Western Pure Alexia

The transition from vision to language: Distinct patterns of functional connectivity for subregions of the visual word form area

A Domain-General Frontoparietal Network Interacts with Domain-Preferential Intermediate Pathways to Support Working Memory Task.

Demystifying the Visual Word Form Area: Visual and Nonvisual Response Properties of Ventral Temporal Cortex with precision fMRI

A Heteromodal Word-Meaning Binding Site in the Visual Word Form Area under Top-Down Frontoparietal Control

Brain Network Reorganization During Visual Search Task Revealed by a Network Analysis of Fixation-Related Potential.

Visual Working-Memory Capacity Load Does Not Modulate Distractor Processing

Visual word processing engages a hierarchical, distributed, and bilateral cortical network

Top-down Processing of Symbolic Meanings Modulates the Visual Word Form Area.

Orthographic and phonological processing in the left ventral occipitotemporal cortex during Chinese word reading

Representational similarity analysis reveals task-dependent semantic influence of the visual word form area

The Functional Neural Architecture of Components of Attention in Language-Processing Tasks

Spatiotemporal and sensory modality attention processing with domain-specific representations in frontoparietal areas

Determination of the posterior boundary of Wernicke's area based on multimodal connectivity profiles

How the intrinsic functional connectivity patterns of the semantic network support semantic processing

Reading reshapes stimulus selectivity in the visual word form area