Abstract:Mental imagery is a process by which thoughts become experienced with sensory characteristics. Yet, it is not clear why mental images appear diminished compared to veridical images, nor how mental images are phenomenologically distinct from hallucinations, another type of non-veridical sensory experience. Current evidence suggests that imagination and veridical perception share neural resources. If so, we argue that considering how neural representations of externally generated stimuli (i.e. sensory input) and internally generated stimuli (i.e. thoughts) might interfere with one another can sufficiently differentiate between veridical, imaginary, and hallucinatory perception. We here use a simple computational model of a serially connected, hierarchical network with bidirectional information flow to emulate the primate visual system. We show that modelling even first approximations of neural competition can more coherently explain imagery phenomenology than non-competitive models. Our simulations predict that, without competing sensory input, imagined stimuli should ubiquitously dominate hierarchical representations. However, with competition, imagination should dominate high-level representations but largely fail to outcompete sensory inputs at lower processing levels. To interpret our findings, we assume that low-level stimulus information (e.g. in early visual cortices) contributes most to the sensory aspects of perceptual experience, while high-level stimulus information (e.g. towards temporal regions) contributes most to its abstract aspects. Our findings therefore suggest that ongoing bottom-up inputs during waking life may prevent imagination from overriding veridical sensory experience. In contrast, internally generated stimuli may be hallucinated when sensory input is dampened or eradicated. Our approach can explain individual differences in imagery, along with aspects of daydreaming, hallucinations, and non-visual mental imagery.

Non-clinical hallucinations and mental imagery across sensory modalities

Multisensory approach in Mental Imagery: ALE meta-analyses comparing Motor, Visual and Auditory Imagery

Characteristics of non-clinical hallucinations: A mixed-methods analysis of auditory, visual, tactile and olfactory hallucinations in a primary voice-hearing cohort

Assessing mental imagery in clinical psychology: A review of imagery measures and a guiding framework

Imagery‐Focused Therapy for Visual Hallucinations: A Case Series

A Review of Multimodal Hallucinations: Categorization, Assessment, Theoretical Perspectives, and Clinical Recommendations

Exploring the cognitive profiles related to unimodal auditory versus multisensory hallucinations in schizophrenia-spectrum disorders

Vividness of positive mental imagery predicts positive emotional response to visually presented Project Soothe pictures

Modelling perception as a hierarchical competition differentiates imagined, veridical, and hallucinated percepts

Mental Imagery Induces Cross-Modal Sensory Plasticity and Changes Future Auditory Perception

Mental imagery as part of an 'inwardly focused' cognitive style

The human imagination: the cognitive neuroscience of visual mental imagery

Neural mechanisms of psychedelic visual imagery

Beyond self-report: Measuring visual, auditory, and tactile mental imagery using a mental comparison task

The spatiotemporal pattern of auditory cortical responses during verbal hallucinations

Hallucinations across sensory domains in people with post-traumatic stress disorder and psychosis

Content-based clustering of hallucinations across sensory modalities in a large online survey

Assessing vividness of mental imagery: The Plymouth Sensory Imagery Questionnaire

Understanding visual hallucinations: A new synthesis

Cognition in relation to non-auditory or multisensory hallucinations in schizophrenia-spectrum disorders: A scoping review