Abstract:Abstract The function of long-term memory is not just to reminisce about the past, but also to make predictions that help us behave appropriately and efficiently in the future. This predictive function of memory provides a new perspective on the classic question from memory research of why we remember some things but not others. If prediction is a key outcome of memory, then the extent to which an item generates a prediction signifies that this information already exists in memory and need not be encoded. We tested this principle using human intracranial EEG as a time-resolved method to quantify prediction in visual cortex during a statistical learning task and link the strength of these predictions to subsequent episodic memory behavior. Epilepsy patients of both sexes viewed rapid streams of scenes, some of which contained regularities that allowed the category of the next scene to be predicted. We verified that statistical learning occurred using neural frequency tagging and measured category prediction with multivariate pattern analysis. Although neural prediction was robust overall, this was driven entirely by items that were subsequently forgotten. Such interference provides a mechanism by which prediction can regulate memory formation to prioritize encoding of information that could help learn new predictive relationships. Significance Statement When faced with a new experience, we are rarely at a loss for what to do. Rather, because many aspects of the world are stable over time, we rely upon past experiences to generate expectations that guide behavior. Here we show that these expectations during a new experience come at the expense of memory for that experience. From intracranial recordings of visual cortex, we decoded what humans expected to see next in a series of photographs based on patterns of neural activity. Photographs that generated strong neural expectations were more likely to be forgotten in a later behavioral memory test. Prioritizing the storage of experiences that currently lead to weak expectations could help improve these expectations in future encounters.

Learned response dynamics reflect stimulus timing and encode temporal expectation violations in superficial layers of mouse V1

Expectation violations produce error signals in mouse V1

Expectation violations enhance neuronal encoding of sensory information in mouse primary visual cortex

Spatiotemporal dynamics across visual cortical laminae support a predictive coding framework for interpreting mismatch responses

Stimulus history, not expectation, drives sensory prediction errors in mammalian cortex

Experience-dependent predictions of feedforward and contextual information in mouse visual cortex

Mesoscale cortical dynamics reflect the interaction of sensory evidence and temporal expectation during perceptual decision-making

Oddball evoked deviant responses reflect complex context dependent expectations in mouse V1

Cerebellar encoding of prior knowledge of temporal statistics

Neural networks representing temporal expectation in mice

Distinct functional classes of excitatory neurons in mouse V1 are differentially modulated by learning and task engagement

Learning to make external sensory stimulus predictions using internal correlations in populations of neurons

Hierarchy of prediction errors shapes the learning of context-dependent sensory representations

Cooperative thalamocortical circuit mechanism for sensory prediction errors

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

Violation of expectation: neural correlates reflect bases of prediction

Opposing Somatic and Dendritic Expression of Stimulus-Selective Response Plasticity in Mouse Primary Visual Cortex

Violated predictions enhance the representational fidelity of visual features in perception

Recurrent cortical networks encode natural sensory statistics via sequence filtering

Predictive learning rules generate a cortical-like replay of probabilistic sensory experiences

Posteromedial cortical networks encode visuomotor prediction errors.