Abstract:When two individuals view the same item, they do not necessarily perceive an item in the same way. If an individual is presented with a stimulus to be recalled later, the information that is encoded is dependent on the features of the stimulus to which one attends. Past studies have shown that, on the group level, verbal and visual information (e.g., words and pictures) are encoded in disparate regions of the brain. However, this account conflates external and internal representational formats, and it also neglects individual differences in attention. In this study, we examined neural and behavioral patterns associated with individual differences in attention to verbal representations-both external and internal. We found that the encoded neural representation of semantic content (meaningful words and pictures) varied as a function of individual differences in verbal attention, independent of the stimulus presentation format. Individuals who demonstrated an attentional bias toward words showed similar multivariate BOLD activity patterns within an a priori speech production network when encoding object names as when encoding pictures of objects. This result indicates that these individuals encode both words and pictures verbally. These effects were not found for non-semantic stimuli (pronounceable non-words and nonsense pictures). Importantly, as expected, no individual differences in neural representation were found in a separate network of regions known to process semantic content independent of format. These results highlight inter-individual divergence and convergence in internal representations of encoded semantic content. SIGNIFICANCE STATEMENT: This study shows how tendencies to attend to word representations is associated with individual differences in encoded neural representations. Individuals who selectively attend to words instead of pictures process semantically meaningful information in language regions of the brain, regardless of whether the information was originally presented as a word or a picture. Though all participants encoded words and pictures similarly in regions that are known to represent domain-general semantic information, only the individuals who were biased towards word representations additionally processed both words and pictures in modality-specific verbal regions. These results demonstrate both the convergence and divergence between individuals that occurs during encoding of meaningful information.

Convergence and Divergence in the Neural Organization of Object Responses to Pictures and Words

Functional anatomy of a common semantic system for words and pictures

Finding Shared Decodable Concepts and their Negations in the Brain

The scope and limits of fine-grained image and category information in the ventral visual pathway

Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex: Evidence from the Structure of the Object Categories and Neural Response Patterns

Contributions of early and mid-level visual cortex to high-level object categorization

The effects of word concreteness on cross-language neural pattern similarity during semantic categorization

Cortical Representations of Concrete and Abstract Concepts in Language Combine Visual and Linguistic Representations

Integrated deep visual and semantic attractor neural networks predict fMRI pattern-information along the ventral object processing pathway

Distributed representation of objects in the human ventral visual pathway

Pulvinar Response Profiles and Connectivity Patterns to Object Domains

Organizational Principles of Abstract Words in the Human Brain.

Individual differences in encoded neural representations within cortical speech production network

A Comprehensive Visual Featural Map in the Human Ventral Temporal Cortex

Representation of Contextually Related Multiple Objects in the Human Ventral Visual Pathway.

Delineating Region-Specific contributions and connectivity patterns for semantic association and categorization through ROI and Granger causality analysis

Holistic Object Representation in Human Visual Cortex

Neural representation of nouns and verbs in congenitally blind and sighted individuals

Convergence of distinct functional networks supporting naming and semantic recognition in the left inferior frontal gyrus

Category-Selective Representation of Relationships in the Visual Cortex

Simple Shape Feature Computation Across Modalities: Convergence and Divergence Between the Ventral and Dorsal Visual Streams.