Abstract:Creating and evaluating predictions are considered important features in sensory perception. Little is known about processing differences between the senses and their cortical substrates. Here, we tested the hypothesis that olfaction, the sense of smell, would be highly dependent on (non-olfactory) object-predictive cues and involve distinct cortical processing features. We developed a novel paradigm to compare prediction error processing across senses. Participants listened to spoken word cues (e.g. “lilac”) and determined whether target stimuli (odors or pictures) matched the word cue or not. In two behavioral experiments (total n = 113; 72 female), the disparity between congruent and incongruent response-times was exaggerated for olfactory relative to visual targets, indicating a greater dependency on predictive verbal cues to process olfactory targets. A pre-registered fMRI study (n = 30; 19 female) revealed the anterior cingulate cortex (a region central for error detection) being more activated by incongruent olfactory targets, indicating a role for olfactory predictive error processing. Additionally, both the primary olfactory and visual cortices were significantly activated for incongruent olfactory targets, suggesting olfactory prediction errors are dependent on cross-sensory processing resources, whereas visual prediction errors are not. We propose that olfaction is characterized by a strong dependency on predictive (non-olfactory) cues, and that odors are evaluated in the context of such predictions by a designated transmodal cortical network. Our results indicate differences in how predictive cues are used by different senses in rapid decision-making. Significance Statement Evaluating predictions is regarded as a fundamental feature of the brain, but evidence is based mostly on visual stimuli. The sense of smell, olfaction, may thus differ from the visual system, but there are no direct comparisons. We show that behaviorally, olfaction relies more than vision on predictive cues when processing perceptual objects (e.g. seeing or smelling lilac and classifying it as such). In a follow-up, pre-registered fMRI experiment, we show that olfactory error signals activate a transmodal cortical network involving primary olfactory and visual cortices, as well as the anterior cingulate cortex. We suggest that human olfaction, due to its limited unisensory cortical resources, is dependent on a transmodal cortical error detection system.

Unisensory visual and auditory objects are processed in olfactory cortex, independently of odor association

Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions

Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

Multisensory-Guided Associative Learning Enhances Multisensory Representation in Primary Auditory Cortex.

Cross-modal Representations in Early Visual and Auditory Cortices Revealed by Multi-Voxel Pattern Analysis.

Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing

Preferential responses to occluded objects in the human visual cortex.

Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex

The auditory-visual multisensory neurons and auditory-visual information integration in rat cortex

Functional Preference for Object Sounds and Voices in the Brain of Early Blind and Sighted Individuals

Single-neuron representations of odours in the human brain

Multisensory Cortical Processing of Object Shape and Its Relation to Mental Imagery

Possible anatomical pathways for short-latency multisensory integration processes in primary sensory cortices

Stability of cross-sensory input to primary somatosensory cortex across experience

Monorhinal and Birhinal Odor Processing in Humans: an fMRI investigation

Anatomical Evidence of Multimodal Integration in Primate Striate Cortex

Selective attention to sound features mediates cross-modal activation of visual cortices

Preprocessing of emotional visual information in the human piriform cortex

Direct piriform-to-auditory cortical projections shape auditory-olfactory integration

Semantic context‐dependent neural representations of odors in the human piriform cortex revealed by 7T MRI

Cross-modal and cross-temporal association in neurons of frontal cortex