Abstract:Abstract The function of long-term memory is not just to reminisce about the past, but also to make predictions that help us behave appropriately and efficiently in the future. This predictive function of memory provides a new perspective on the classic question from memory research of why we remember some things but not others. If prediction is a key outcome of memory, then the extent to which an item generates a prediction signifies that this information already exists in memory and need not be encoded. We tested this principle using human intracranial EEG as a time-resolved method to quantify prediction in visual cortex during a statistical learning task and link the strength of these predictions to subsequent episodic memory behavior. Epilepsy patients of both sexes viewed rapid streams of scenes, some of which contained regularities that allowed the category of the next scene to be predicted. We verified that statistical learning occurred using neural frequency tagging and measured category prediction with multivariate pattern analysis. Although neural prediction was robust overall, this was driven entirely by items that were subsequently forgotten. Such interference provides a mechanism by which prediction can regulate memory formation to prioritize encoding of information that could help learn new predictive relationships. Significance Statement When faced with a new experience, we are rarely at a loss for what to do. Rather, because many aspects of the world are stable over time, we rely upon past experiences to generate expectations that guide behavior. Here we show that these expectations during a new experience come at the expense of memory for that experience. From intracranial recordings of visual cortex, we decoded what humans expected to see next in a series of photographs based on patterns of neural activity. Photographs that generated strong neural expectations were more likely to be forgotten in a later behavioral memory test. Prioritizing the storage of experiences that currently lead to weak expectations could help improve these expectations in future encounters.

Decoding episodic autobiographical memory in naturalistic virtual reality

The formation of episodic autobiographical memory is predicted by mental imagery, self-reference, and anticipated details

Comparing episodic memory outcomes from walking augmented reality and stationary virtual reality encoding experiences

The role of bodily self-consciousness in episodic memory of naturalistic events: an immersive virtual reality study

A virtual reality paradigm with dynamic scene stimuli for use in memory research

Embodiment in episodic memory through premotor-hippocampal coupling

Common and distinct correlates of construction and elaboration of episodic-autobiographical memory: An ALE meta-analysis

Phase-Amplitude Coupling and Phase Synchronization Between Medial Temporal, Frontal and Posterior Brain Regions Support Episodic Autobiographical Memory Recall

The relationship between environmentally induced emotion and memory for a naturalistic virtual experience

Episodic memory and recognition are influenced by cues' sensory modality: comparing odours, music and faces using virtual reality

An ecologically valid examination of event-based and time-based prospective memory using immersive virtual reality: the influence of attention, memory, and executive function processes on real-world prospective memory

New Trends in Episodic Memory Assessment: Immersive 360° Ecological Videos

Neural correlates of memory in a naturalistic spatiotemporal context

Immersive Versus Non-immersive Experience: Exploring the Feasibility of Memory Assessment Through 360° Technology

Neural correlates of memory in a naturalistic spatiotemporal context.

Detecting the neural correlates of episodic memory with mobile EEG: Recollecting objects in the real world

Comparing encoding mechanisms in realistic virtual reality and conventional 2D laboratory settings: Event-related potentials in a repetition suppression paradigm

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

Sense of Agency during Encoding Predicts Subjective Reliving

Peering into the future: Eye movements predict neural repetition effects during episodic simulation

More than the sum of its parts: investigating episodic memory as a multidimensional cognitive process