Abstract:How the human brain reconstructs, step-by-step, the core elements of past experiences is still unclear. Here, we map the spatiotemporal trajectories along which visual object memories are reconstructed during associative recall. Specifically, we inquire whether retrieval reinstates feature representations in a copy-like but reversed direction with respect to the initial perceptual experience, or alternatively, this reconstruction involves format transformations and regions beyond initial perception. Participants from two cohorts studied new associations between verbs and randomly paired object images, and subsequently recalled the objects when presented with the corresponding verb cue. We first analyze multivariate fMRI patterns to map where in the brain high- and low-level object features can be decoded during perception and retrieval, showing that retrieval is dominated by conceptual features, represented in comparatively late visual and parietal areas. A separately acquired EEG dataset is then used to track the temporal evolution of the reactivated patterns using similarity-based EEG–fMRI fusion. This fusion suggests that memory reconstruction proceeds from anterior frontotemporal to posterior occipital and parietal regions, in line with a conceptual-to-perceptual gradient but only partly following the same trajectories as during perception. Specifically, a linear regression statistically confirms that the sequential activation of ventral visual stream regions is reversed between image perception and retrieval. The fusion analysis also suggests an information relay to frontoparietal areas late during retrieval. Together, the results shed light onto the temporal dynamics of memory recall and the transformations that the information undergoes between the initial experience and its later reconstruction from memory.

When you look at your past: Eye movement during autobiographical retrieval

Remembrance with gazes passed: Eye movements precede continuous recall of episodic details of real-life events

How shifting visual perspective during autobiographical memory retrieval influences emotion: A change in retrieval orientation

Seeing the Future: Anticipatory Eye Gaze as a Marker of Memory

The effects of eye movements on the content and characteristics of unpleasant autobiographical memories: an extended replication study

Eye movements as a tool to investigate exemplar retrieval in judgments

Attention-based rehearsal: Eye movements reveal how visuospatial information is maintained in working memory.

Long-term memory and hippocampal function support predictive gaze control during goal-directed search

The intersection between the oculomotor and hippocampal memory systems: empirical developments and clinical implications

Eye Movements in Psychiatry

Peering into the future: Eye movements predict neural repetition effects during episodic simulation

Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory

Eye Movement Research in the Twenty-First Century—a Window to the Brain, Mind, and More

Eye fixation-related fronto-parietal neural network correlates of memory retrieval.

Gaze patterns reflect the retrieval and selection of memories in a context-dependent object location retrieval task

Reconstructing Spatiotemporal Trajectories of Visual Object Memories in the Human Brain

Autobiographical Implicit Association Test and eye movements: fixations topography enables detection of autobiographical memories

Monitoring Eye Movements to Investigate the Picture Superiority Effect in Spatial Memory

Precise Timing Matters: Modulating Human Memory by Synchronizing Hippocampal Stimulation to Saccadic Event Related Potentials

Active inhibition and memory promote exploration and search of natural scenes

Eye-tracking indices of impaired encoding of visual short-term memory in familial Alzheimer's disease