Abstract:Abstract The function of long-term memory is not just to reminisce about the past, but also to make predictions that help us behave appropriately and efficiently in the future. This predictive function of memory provides a new perspective on the classic question from memory research of why we remember some things but not others. If prediction is a key outcome of memory, then the extent to which an item generates a prediction signifies that this information already exists in memory and need not be encoded. We tested this principle using human intracranial EEG as a time-resolved method to quantify prediction in visual cortex during a statistical learning task and link the strength of these predictions to subsequent episodic memory behavior. Epilepsy patients of both sexes viewed rapid streams of scenes, some of which contained regularities that allowed the category of the next scene to be predicted. We verified that statistical learning occurred using neural frequency tagging and measured category prediction with multivariate pattern analysis. Although neural prediction was robust overall, this was driven entirely by items that were subsequently forgotten. Such interference provides a mechanism by which prediction can regulate memory formation to prioritize encoding of information that could help learn new predictive relationships. Significance Statement When faced with a new experience, we are rarely at a loss for what to do. Rather, because many aspects of the world are stable over time, we rely upon past experiences to generate expectations that guide behavior. Here we show that these expectations during a new experience come at the expense of memory for that experience. From intracranial recordings of visual cortex, we decoded what humans expected to see next in a series of photographs based on patterns of neural activity. Photographs that generated strong neural expectations were more likely to be forgotten in a later behavioral memory test. Prioritizing the storage of experiences that currently lead to weak expectations could help improve these expectations in future encounters.

Dynamics of fMRI patterns reflect sub-second activation sequences and reveal replay in human visual cortex

Replay in human visual cortex is linked to the formation of successor representations and independent of consciousness

Hippocampal replay sequence governed by spontaneous brain-wide dynamics

Replay-triggered brain-wide activation in humans

Fast-backward Replay of Sequentially Memorized Items in Humans.

Spatio-Temporal Investigation of Brain-Wide Sequences

150 Backbone Spiking Sequence as a Basis for Preplay, Replay, and Default States in Human Cortex

Cue-triggered activity replay in human early visual cortex

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

Time for Retrieval in Recurrent Associative Memories

Progressive multi-stage extrapolation of predictable motion in human visual cortex

Non-feature-specific elevated responses and feature-specific backward replay in human brain induced by visual sequence exposure

Having your voxels and timing them too?

Exposure-based sequence learning induces backward replay in the human visual cortex

Discrete ripples reflect a spectrum of synchronous spiking activity in human association cortex

Neuronal sequences in population bursts encode information in human cortex

Ripples reflect a spectrum of synchronous spiking activity in human anterior temporal lobe

Early recurrence and ongoing parietal driving during elementary visual processing

Human hippocampal and entorhinal neurons encode the temporal structure of experience

Neural Representations of Dynamic Visual Stimuli

Dynamical Modulation of Hippocampal Replay Sequences through Firing Rate Adaptation