How the 'mind's eye' calls up visual memories from the brain

Julian Nowogrodzki

DOI: https://doi.org/10.1038/d41586-024-01757-3

IF: 64.8

2024-06-16

Nature

Abstract:Different patterns of brain activity help to distinguish between images recalled from memory and the sight of physical objects. Different patterns of brain activity help to distinguish between images recalled from memory and the sight of physical objects.

multidisciplinary sciences

What problem does this paper attempt to address?

Imagery neurons in the human brain

G Kreiman,C Koch,I Fried

DOI: https://doi.org/10.1038/35042575

IF: 64.8

2000-11-16

Nature

Abstract:Vivid visual images can be voluntarily generated in our minds in the absence of simultaneous visual input. While trying to count the number of flowers in Van Gogh's Sunflowers, understanding a description or recalling a path, subjects report forming an image in their "mind's eye". Whether this process is accomplished by the same neuronal mechanisms as visual perception has long been a matter of debate. Evidence from functional imaging, psychophysics, neurological studies and monkey electrophysiology suggests a common process, yet there are patients with deficits in one but not the other. Here we directly investigated the neuronal substrates of visual recall by recording from single neurons in the human medial temporal lobe while the subjects were asked to imagine previously viewed images. We found single neurons in the hippocampus, amygdala, entorhinal cortex and parahippocampal gyrus that selectively altered their firing rates depending on the stimulus the subjects were imagining. Of the neurons that fired selectively during both vision and imagery, the majority (88%) had identical selectivity. Our study reveals single neuron correlates of volitional visual imagery in humans and suggests a common substrate for the processing of incoming visual information and visual recall.
Visual Imagery and False Memory for Pictures: A Functional Magnetic Resonance Imaging Study in Healthy Participants

Christian Stephan-Otto,Sara Siddi,Carl Senior,Daniel Muñoz-Samons,Susana Ochoa,Ana María Sánchez-Laforga,Gildas Brébion

DOI: https://doi.org/10.1371/journal.pone.0169551

IF: 3.7

2017-01-03

PLoS ONE

Abstract:BACKGROUND: Visual mental imagery might be critical in the ability to discriminate imagined from perceived pictures. Our aim was to investigate the neural bases of this specific type of reality-monitoring process in individuals with high visual imagery abilities.METHODS: A reality-monitoring task was administered to twenty-six healthy participants using functional magnetic resonance imaging. During the encoding phase, 45 words designating common items, and 45 pictures of other common items, were presented in random order. During the recall phase, participants were required to remember whether a picture of the item had been presented, or only a word. Two subgroups of participants with a propensity for high vs. low visual imagery were contrasted.RESULTS: Activation of the amygdala, left inferior occipital gyrus, insula, and precuneus were observed when high visual imagers encoded words later remembered as pictures. At the recall phase, these same participants activated the middle frontal gyrus and inferior and superior parietal lobes when erroneously remembering pictures.CONCLUSIONS: The formation of visual mental images might activate visual brain areas as well as structures involved in emotional processing. High visual imagers demonstrate increased activation of a fronto-parietal source-monitoring network that enables distinction between imagined and perceived pictures.

multidisciplinary sciences
Mind’s Selective Attention to Previous Experience

Antonis Theofilidis,

DOI: https://doi.org/10.47363/jpsrr/2021(3)130

2021-09-30

Abstract:The basic arguments for a mental image model of thought are based on neuropsychological evidence. Farah found that the same brain regions are activated during both mental representation and actual perception, while Bishiah found that brain traumas that affected perception, also affected the ability to create mental images. Pylyshyn on the other hand, argues that all mental images are guided by ‘’cognitive penetrability’’, thus on their very basis, are manipulated by certain propositional elements. Given this difficulty, Kargopoulos hinted towards further research, featuring shapes and solid objects, for which subjects have no prior extensive knowledge. This would force subjects to use non-semantic strategies of representation, meaning mental imagery. Hinton’s cube problem conforms to these requirements. Hinton’s problem aligns with the idea that spatial tasks (especially tasks with cubes that change layout) are guided by propositional cues (our knowledge about squares) and supports Pylyshyn’s position. Using one of the simplest objects, a cube, Hinton showed that as soon as this shape changes its mental arrangement in space, even suspicious -as to the nature of the experiment- participants will make mistakes that are not present when they manipulate a mental image of the cube sitting on its typical array [1-5]. Aim: Our goal was to investigate the relationship between spatio-visual skill and the ability for mental partitioning in healthy subjects. Methodology: We used 2 groups (344 participants) a control and an experimental one. In the control group, we presented a Moebius’ strip, in the experimental group, we presented the same Moebius’ strip and asked them to mentally represent it. All participants asked to mentally partition the strip. Results: Of the 344 participants, only 31 managed to give the correct number of vertices in space. Though people had a hard time manipulating the cube’s mental image, their success rates were much higher for the Hinton 1 task in which propositional representation was more accessible. Only 9 of the 344 participants could find the correct answer for the Moebius strip task in which mental manipulation of the strip image was impossible. Conclusions: We come to the conclusion that the relationship between ‘’seeing’’ and ‘’knowing’’ is more complex, not just on the level of the mental image level but also on the level of perception. Our findings bring back to the scientific background the idea that the mind’s selective attention to previous experience and cognitive schemas will decidedly affect human thought
Reconstructing Spatiotemporal Trajectories of Visual Object Memories in the Human Brain

Julia Lifanov-Carr,Benjamin J. Griffiths,Juan Linde-Domingo,Catarina S. Ferreira,Martin Wilson,Stephen D. Mayhew,Ian Charest,Maria Wimber

DOI: https://doi.org/10.1523/eneuro.0091-24.2024

2024-09-28

eNeuro

Abstract:How the human brain reconstructs, step-by-step, the core elements of past experiences is still unclear. Here, we map the spatiotemporal trajectories along which visual object memories are reconstructed during associative recall. Specifically, we inquire whether retrieval reinstates feature representations in a copy-like but reversed direction with respect to the initial perceptual experience, or alternatively, this reconstruction involves format transformations and regions beyond initial perception. Participants from two cohorts studied new associations between verbs and randomly paired object images, and subsequently recalled the objects when presented with the corresponding verb cue. We first analyze multivariate fMRI patterns to map where in the brain high- and low-level object features can be decoded during perception and retrieval, showing that retrieval is dominated by conceptual features, represented in comparatively late visual and parietal areas. A separately acquired EEG dataset is then used to track the temporal evolution of the reactivated patterns using similarity-based EEG–fMRI fusion. This fusion suggests that memory reconstruction proceeds from anterior frontotemporal to posterior occipital and parietal regions, in line with a conceptual-to-perceptual gradient but only partly following the same trajectories as during perception. Specifically, a linear regression statistically confirms that the sequential activation of ventral visual stream regions is reversed between image perception and retrieval. The fusion analysis also suggests an information relay to frontoparietal areas late during retrieval. Together, the results shed light onto the temporal dynamics of memory recall and the transformations that the information undergoes between the initial experience and its later reconstruction from memory.

neurosciences
Reading the mind's eye: Decoding category information during mental imagery

Leila Reddy,Naotsugu Tsuchiya,Thomas Serre

DOI: https://doi.org/10.1016/j.neuroimage.2009.11.084

IF: 5.7

2010-04-01

NeuroImage

Abstract:Category information for visually presented objects can be read out from multi-voxel patterns of fMRI activity in ventral-temporal cortex. What is the nature and reliability of these patterns in the absence of any bottom-up visual input, for example, during visual imagery? Here, we first ask how well category information can be decoded for imagined objects and then compare the representations evoked during imagery and actual viewing. In an fMRI study, four object categories (food, tools, faces, buildings) were either visually presented to subjects, or imagined by them. Using pattern classification techniques, we could reliably decode category information (including for non-special categories, i.e., food and tools) from ventral-temporal cortex in both conditions, but only during actual viewing from retinotopic areas. Interestingly, in temporal cortex when the classifier was trained on the viewed condition and tested on the imagery condition, or vice versa, classification performance was comparable to within the imagery condition. The above results held even when we did not use information in the specialized category-selective areas. Thus, the patterns of representation during imagery and actual viewing are in fact surprisingly similar to each other. Consistent with this observation, the maps of "diagnostic voxels" (i.e., the classifier weights) for the perception and imagery classifiers were more similar in ventral-temporal cortex than in retinotopic cortex. These results suggest that in the absence of any bottom-up input, cortical back projections can selectively re-activate specific patterns of neural activity.

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
Cross-Modal Interaction Between Auditory and Visual Input Impacts Memory Retrieval

Viorica Marian,Sayuri Hayakawa,Scott R Schroeder

DOI: https://doi.org/10.3389/fnins.2021.661477

2021-07-26

Abstract:How we perceive and learn about our environment is influenced by our prior experiences and existing representations of the world. Top-down cognitive processes, such as attention and expectations, can alter how we process sensory stimuli, both within a modality (e.g., effects of auditory experience on auditory perception), as well as across modalities (e.g., effects of visual feedback on sound localization). Here, we demonstrate that experience with different types of auditory input (spoken words vs. environmental sounds) modulates how humans remember concurrently-presented visual objects. Participants viewed a series of line drawings (e.g., picture of a cat) displayed in one of four quadrants while listening to a word or sound that was congruent (e.g., "cat" or <meow>), incongruent (e.g., "motorcycle" or <vroom-vroom>), or neutral (e.g., a meaningless pseudoword or a tonal beep) relative to the picture. Following the encoding phase, participants were presented with the original drawings plus new drawings and asked to indicate whether each one was "old" or "new." If a drawing was designated as "old," participants then reported where it had been displayed. We find that words and sounds both elicit more accurate memory for what objects were previously seen, but only congruent environmental sounds enhance memory for where objects were positioned - this, despite the fact that the auditory stimuli were not meaningful spatial cues of the objects' locations on the screen. Given that during real-world listening conditions, environmental sounds, but not words, reliably originate from the location of their referents, listening to sounds may attune the visual dorsal pathway to facilitate attention and memory for objects' locations. We propose that audio-visual associations in the environment and in our previous experience jointly contribute to visual memory, strengthening visual memory through exposure to auditory input.
Neuronal representation of visual working memory content in the primate primary visual cortex

Jiancao Huang,Tian Wang,Weifeng Dai,Yang Li,Yi Yang,Yange Zhang,Yujie Wu,Tingting Zhou,Dajun Xing

DOI: https://doi.org/10.1126/sciadv.adk3953

IF: 13.6

2024-06-16

Science Advances

Abstract:The human ability to perceive vivid memories as if they "float" before our eyes, even in the absence of actual visual stimuli, captivates the imagination. To determine the neural substrates underlying visual memories, we investigated the neuronal representation of working memory content in the primary visual cortex of monkeys. Our study revealed that neurons exhibit unique responses to different memory contents, using firing patterns distinct from those observed during the perception of external visual stimuli. Moreover, this neuronal representation evolves with alterations in the recalled content and extends beyond the retinotopic areas typically reserved for processing external visual input. These discoveries shed light on the visual encoding of memories and indicate avenues for understanding the remarkable power of the mind's eye.

multidisciplinary sciences
Using imagination and the contents of memory to create new scene and object representations: A functional MRI study

Qun Ye,Celia Fidalgo,Patrick Byrne,Luis Eduardo Muñoz,Jonathan S Cant,Andy C H Lee

DOI: https://doi.org/10.1016/j.neuropsychologia.2024.109000

IF: 3.054

2024-11-05

Neuropsychologia

Abstract:Humans can use the contents of memory to construct scenarios and events that they have not encountered before, a process colloquially known as imagination. Much of our current understanding of the neural mechanisms mediating imagination is limited by paradigms that rely on participants' subjective reports of imagined content. Here, we used a novel behavioral paradigm that was designed to systematically evaluate the contents of an individual's imagination. Participants first learned the layout of four distinct rooms containing five wall segments with differing geometrical characteristics, each associated with a unique object. During functional MRI, participants were then shown two different wall segments or objects on each trial and asked to first, retrieve the associated objects or walls, respectively (retrieval phase) and then second, imagine the two objects side-by-side or combine the two wall segments (imagination phase). Importantly, the contents of each participant's imagination were interrogated by having them make a same/different judgment about the properties of the imagined objects or scenes. Using univariate and multivariate analyses, we observed widespread activity across occipito-temporal cortex for the retrieval of objects and for the imaginative creation of scenes. Interestingly, a classifier, whether trained on the imagination or retrieval data, was able to successfully differentiate the neural patterns associated with the imagination of scenes from that of objects. Our results reveal neural differences in the cued retrieval of object and scene memoranda, demonstrate that different representations underlie the creation and/or imagination of scene and object content, and highlight a novel behavioral paradigm that can be used to systematically evaluate the contents of an individual's imagination.
Decoding reveals the contents of visual working memory in early visual areas

Stephenie A. Harrison,Frank Tong

DOI: https://doi.org/10.1038/nature07832

IF: 64.8

2009-02-18

Nature

Abstract:Seeing is rememberingAlthough we can hold several different items in working visual memory, how we remember specific details and visual features of individual objects remains a mystery. The neurons in the higher-order areas responsible for working memory seem to exhibit no selectivity for visual detail, and the early visual areas of the cerebral cortex are uniquely able to process incoming visual signals from the eye but, it was thought, not to perform higher cognitive functions such as memory. Using a new technique for decoding data from functional magnetic resonance imaging (fMRI), Stephanie Harrison and Frank Tong have found that early visual areas can retain specific information about features held in working memory. Volunteers were shown two striped patterns at different orientations and asked to memorize one of the orientations whilst being scanned by fMRI. From analysis of the scans it was possible to predict which of the two orientation patterns a subject was being retained in over 80% of tests.

multidisciplinary sciences
Visual imagery of familiar people and places in category selective cortex

Catriona L. Scrivener,Jessica A. Teed,Edward H. Silson

DOI: https://doi.org/10.1101/2024.09.13.612846

2024-09-16

Abstract:Visual mental imagery is a dynamic process that involves a network of multiple brain regions. We used an electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) fusion approach to ask how the neural dynamics of category selective mental imagery in EEG related to activity within medial parietal, ventral temporal, and primary visual cortex (V1). Subjects attended separate EEG and fMRI sessions where they were asked to recall personally familiar people and place stimuli. The fMRI contrast of places versus people successfully replicated previous findings of category-selectivity in the medial parietal cortex during visual recall ( ), as well as other regions including the ventral and lateral place memory areas, the fusiform face area, and frontal eye fields. Using multivariate decoding analysis in pre-defined fMRI regions of interest (ROIs), we tested the hypothesis that we would be able to decode individual stimuli within the preferred category for each region. This was largely the case in the ventral temporal ROIs, but a more complex pattern emerged in the medial parietal cortex; these regions represented information during imagery that was not restricted to their preferred category. EEG-fMRI fusion indicated that the timing of both medial parietal and ventral temporal involvement peaked early on during recall but did not clearly differ from each other. However, place-selective regions generally peaked earlier than people-selective regions, suggesting that representations of place stimuli evolved more quickly for these subjects. This mirrors the results from EEG stimuli decoding, where individual places were decodable earlier in time than people. In contrast, fusion correlations in V1 occurred later during the recall period, possibly reflecting the top-down progression of mental imagery from category-selective regions to primary visual cortex.

Neuroscience
Visual recognition memory of scenes is driven by categorical, not sensory, visual representations.

Ricardo Morales-Torres,Erik A. Wing,Lifu Deng,Simon W. Davis,Roberto Cabeza

DOI: https://doi.org/10.1523/jneurosci.1479-23.2024

2024-04-03

Abstract:When we perceive a scene, our brain processes various types of visual information simultaneously, ranging from sensory features, such as line orientations and colors, to categorical features, such as objects and their arrangements. Whereas the role of sensory and categorical visual representations in predicting subsequent memory has been studied using isolated objects, their impact on memory for complex scenes remains largely unknown. To address this gap, we conducted an fMRI study in which female and male participants encoded pictures of familiar scenes (e.g., an airport picture) and later recalled them, while rating the vividness of their visual recall. Outside the scanner, participants had to distinguish each seen scene (e.g., an airport picture) from three similar lures (e.g., 3 airport pictures). We modeled the sensory and categorical visual features of multiple scenes using both early and late layers of a deep convolutional neural network. Then, we applied representational similarity analysis to determine which brain regions represented stimuli in accordance with the sensory and categorical models. We found that categorical, but not sensory, representations predicted subsequent memory. In line with the previous result, only for the categorical model, the average recognition performance of each scene exhibited a positive correlation with the average visual dissimilarity between the item in question and its respective lures. These results strongly suggest that even in memory tests that ostensibly rely solely on visual cues (such as force-choice visual recognition with similar distractors), memory decisions for scenes may be primarily influenced by categorical rather than sensory representations. Significance Statement Our memory for real-world scenes often comprises a tableau of complex visual features, but recent findings challenge the view that our memories of such stimuli rely on purely visual information. Instead, it appears that our memory for scenes is heavily influenced by higher-level categorical information. Analyzing cortical representations in regions responsive to both categorical and sensory features, we discovered that only the former can reliably predict memory outcomes. Moreover, the distinctiveness of scenes in terms of their categoric features among similar examples is positively associated with our ability to accurately recognize previously encountered scenes. In essence, this study sheds light on how our brains rely on categorical information to recognize natural scenes.

neurosciences
Reconstructing Spatio-Temporal Trajectories of Visual Object Memories in the Human Brain

Julia Lifanov,Benjamin J. Griffiths,Juan Linde-Domingo,Catarina S. Ferreira,Martin Wilson,Stephen D. Mayhew,Ian Charest,Maria Wimber

DOI: https://doi.org/10.1101/2022.12.15.520591

2024-02-20

Abstract:Our understanding of how information unfolds when we recall events from memory remains limited. In this study, we investigate whether the reconstruction of visual object memories follows a backward trajectory along the ventral visual stream with respect to perception, such that their neural feature representations are gradually reinstated from late areas close to the hippocampus backwards to lower-level sensory areas. We use multivariate analyses of fMRI activation patterns to map high-and low-level features of the object memories onto the brain during retrieval, and EEG-fMRI fusion to track the temporal evolution of the reactivated patterns. Participants studied new associations between verbs and randomly paired object images in an encoding phase, and subsequently recalled the objects when presented with the corresponding verb cue. Decoding reactivated memory features from fMRI activity revealed that retrieval patterns were dominated by conceptual features, represented in comparatively late visual and parietal areas. Representational-similarity-based fusion then allowed us to map the EEG patterns that emerged at each given time point of a trial onto the spatially resolved fMRI patterns. This fusion suggests that memory reconstruction proceeds from anterior fronto-temporal to posterior occipital and parietal regions, partly in line with a semantic-to-perceptual gradient. A linear regression on the peak time points of reactivated brain regions statistically confirms that the temporal progression is reversed with respect to encoding in ventral stream areas. Together, the results shed light onto the spatio-temporal trajectories along which memories and their constituent features are reconstructed during associative retrieval.

Neuroscience
How do eyes and brain search a randomly structured uninformative scene? Exploiting a basic interplay of attention and memory

Lorenzo Resca,Pamela M. Greenwood,Terrance D. Keech

DOI: https://doi.org/10.48550/arXiv.2004.02873

2020-04-07

Abstract:We tracked the eye movements of seven young and seven older adults performing a conjunctive visual search task similar to that performed by two highly trained monkeys in an original influential study of Motter and Belky (1998a, 1998b). We obtained results consistent with theirs regarding elements of perception, selection, attention and object recognition, but we found a much greater role played by long-range memory. A design inadequacy in the original Motter-Belky study is not sufficient to explain such discrepancy, nor is the high level of training of their monkeys. Perhaps monkeys and humans do not use mnemonic resources compatibly already in basic visual search tasks, contrary to a common expectation, further supported by cortical representation studies. We also found age-related differences in various measures of eye movements, consistently indicating slightly reduced conspicuity areas for the older adults, hence, correspondingly reduced processing and memory capacities. However, because of sample size and age differential limitations, statistically significant differences were found only for a few variables, most notably overall reaction times. Results reported here provide the basis for demonstrating the formation of spiraling or circulating patterns in the eye movement trajectories and for developing corresponding computational models and simulations.

Neurons and Cognition
A shared code for perceiving and imagining objects in human ventral temporal cortex

Varun S Wadia,Chrystal M Reed,Jeffrey M Chung,Lisa M Bateman,Adam N Mamelak,Ueli Rutishauser,Doris Y Tsao

DOI: https://doi.org/10.1101/2024.10.05.616828

2024-10-06

Abstract:Mental imagery is a remarkable phenomenon that allows us to remember previous experiences and imagine new ones. Animal studies have yielded rich insight into mechanisms for visual perception, but the neural mechanisms for visual imagery remain poorly understood. Here, we first determined that ~80% of visually responsive single neurons in human ventral temporal cortex (VTC) used a distributed axis code to represent objects. We then used that code to reconstruct objects and generate maximally effective synthetic stimuli. Finally, we recorded responses from the same neural population while subjects imagined specific objects and found that ~40% of axis-tuned VTC neurons recapitulated the visual code. Our findings reveal that visual imagery is supported by reactivation of the same neurons involved in perception, providing single neuron evidence for existence of a generative model in human VTC.

Neuroscience
Reading the mind's eye: Online detection of visuo-spatial working memory and visual imagery in the inferior temporal lobe

Carlos M. Hamamé,Juan R. Vidal,Tomás Ossandón,Karim Jerbi,Sarang S. Dalal,Lorella Minotti,Olivier Bertrand,Philippe Kahane,Jean-Philippe Lachaux

DOI: https://doi.org/10.1016/j.neuroimage.2011.07.087

IF: 5.7

2012-01-01

NeuroImage

Abstract:Several brain regions involved in visual perception have been shown to also participate in non-sensory cognitive processes of visual representations. Here we studied the role of ventral visual pathway areas in visual imagery and working memory. We analyzed intracerebral EEG recordings from the left inferior temporal lobe of an epileptic patient during working memory tasks and mental imagery. We found that high frequency gamma-band activity (50-150 Hz) in the inferior temporal gyrus (ITG) increased with memory load only during visuo-spatial, but not verbal, working memory. Using a real-time set-up to measure and visualize gamma-band activity online--BrainTV--we found a systematic activity increase in ITG when the patient was visualizing a letter (visual imagery), but not during perception of letters. In contrast, only 7 mm more medially, neurons located in the fusiform gyrus exhibited a complete opposite pattern, responding during verbal working memory retention and letter presentation, but not during imagery or visuo-spatial working memory maintenance. Talairach coordinates indicate that the fusiform contact site corresponds to the word form area, suggesting that this region has a role not only in processing letter-strings, but also in working memory retention of verbal information. We conclude that neural networks supporting imagination of a visual element are not necessarily the same as those underlying perception of that element. Additionally, we present evidence that gamma-band activity in the inferior temporal lobe, can be used as a direct measure of the efficiency of top-down attentional control over visual areas with implications for the development of novel brain-computer interfaces. Finally, by just reading gamma-band activity in these two recording sites, it is possible to determine, accurately and in real-time, whether a given memory content is verbal or visuo-spatial.

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
Shared memories driven by the intrinsic memorability of items

Wilma A. Bainbridge

DOI: https://doi.org/10.48550/arXiv.2104.06937

2021-04-15

Abstract:When we experience an event, it feels like our previous experiences, our interpretations of that event (e.g., aesthetics, emotions), and our current state will determine how we will remember it. However, recent work has revealed a strong sway of the visual world itself in influencing what we remember and forget. Certain items -- including certain faces, words, images, and movements -- are intrinsically memorable or forgettable across observers, regardless of individual differences. Further, neuroimaging research has revealed that the brain is sensitive to memorability both rapidly and automatically during late perception. These strong consistencies in memory across people may reflect the broad organizational principles of our sensory environment, and may reveal how the brain prioritizes information before encoding items into memory. In this chapter, I will discuss our current state-of-the-art understanding of memorability for visual information, and what these findings imply about how we perceive and remember visual events.

Neurons and Cognition,Computer Vision and Pattern Recognition
Transient Activity in the Human Calcarine Cortex During Visual-Mental Imagery: An Event-Related fMRI Study

Isabelle Klein,Anne-Lise Paradis,Jean-Baptiste Poline,Stephen M. Kosslyn,Denis Le Bihan

DOI: https://doi.org/10.1162/089892900564037

2000-11-01

Journal of Cognitive Neuroscience

Abstract:Abstract Although it is largely accepted that visual-mental imagery and perception draw on many of the same neural structures, the existence and nature of neural processing in the primary visual cortex (or area V1) during visual imagery remains controversial. We tested two general hypotheses: The first was that V1 is activated only when images with many details are formed and used, and the second was that V1 is activated whenever images are formed, even if they are not necessarily used to perform a task. We used event-related functional magnetic resonance imaging (ER-fMRI) to detect and characterize the activity in the calcarine sulcus (which contains the primary visual cortex) during single instances of mental imagery. The results revealed reproducible transient activity in this area whenever participants generated or evaluated a mental image. This transient activity was strongly enhanced when participants evaluated characteristics of objects, whether or not details actually needed to be extracted from the image to perform the task. These results show that visual imagery processing commonly involves the earliest stages of the visual system.

psychology, experimental,neurosciences
The human imagination: the cognitive neuroscience of visual mental imagery

Joel Pearson,Joel Pearson

DOI: https://doi.org/10.1038/s41583-019-0202-9

IF: 38.755

2019-08-05

Nature Reviews Neuroscience

Abstract:Mental imagery can be advantageous, unnecessary and even clinically disruptive. With methodological constraints now overcome, research has shown that visual imagery involves a network of brain areas from the frontal cortex to sensory areas, overlapping with the default mode network, and can function much like a weak version of afferent perception. Imagery vividness and strength range from completely absent (aphantasia) to photo-like (hyperphantasia). Both the anatomy and function of the primary visual cortex are related to visual imagery. The use of imagery as a tool has been linked to many compound cognitive processes and imagery plays both symptomatic and mechanistic roles in neurological and mental disorders and treatments.

neurosciences

How the 'mind's eye' calls up visual memories from the brain

Imagery neurons in the human brain

Visual Imagery and False Memory for Pictures: A Functional Magnetic Resonance Imaging Study in Healthy Participants

Mind’s Selective Attention to Previous Experience

Reconstructing Spatiotemporal Trajectories of Visual Object Memories in the Human Brain

Reading the mind's eye: Decoding category information during mental imagery

Cross-Modal Interaction Between Auditory and Visual Input Impacts Memory Retrieval

Neuronal representation of visual working memory content in the primate primary visual cortex

Using imagination and the contents of memory to create new scene and object representations: A functional MRI study

Decoding reveals the contents of visual working memory in early visual areas

Visual imagery of familiar people and places in category selective cortex

Visual recognition memory of scenes is driven by categorical, not sensory, visual representations.

Reconstructing Spatio-Temporal Trajectories of Visual Object Memories in the Human Brain

How do eyes and brain search a randomly structured uninformative scene? Exploiting a basic interplay of attention and memory

A shared code for perceiving and imagining objects in human ventral temporal cortex

Reading the mind's eye: Online detection of visuo-spatial working memory and visual imagery in the inferior temporal lobe

Shared memories driven by the intrinsic memorability of items

Transient Activity in the Human Calcarine Cortex During Visual-Mental Imagery: An Event-Related fMRI Study

The human imagination: the cognitive neuroscience of visual mental imagery