Abstract:Comparing expectation with experience is an important neural computation performed throughout the brain and is a hallmark of predictive processing. Experiments that alter the sensory outcome of an animal’s behavior reveal enhanced neural responses to unexpected self-generated stimuli, indicating that populations of neurons in sensory cortex may reflect prediction errors – mismatches between expectation and experience. However, enhanced neural responses to self-generated stimuli could also arise through non-predictive mechanisms, such as the movement-based facilitation of a neuron’s inherent sound responses. If sensory prediction error neurons exist in sensory cortex, it is unknown whether they manifest as general error responses, or respond with specificity to errors in distinct stimulus dimensions. To answer these questions, we trained mice of either sex to expect the outcome of a simple sound-generating behavior and recorded auditory cortex activity as mice heard either the expected sound or sounds that deviated from expectation in one of multiple distinct dimensions. Our data reveal that the auditory cortex learns to suppress responses to self-generated sounds along multiple acoustic dimensions simultaneously. We identify a distinct population of auditory cortex neurons that are not responsive to passive sounds or to the expected sound but that encode prediction errors. These prediction error neurons are abundant only in animals with a learned motor-sensory expectation, and encode one or two specific violations rather than a generic error signal. Together, these findings reveal that cortical predictions about self-generated sounds have specificity in multiple simultaneous dimensions and that cortical prediction error neurons encode specific violations from expectation. Significance Statement Audette et. al record neural activity in the auditory cortex while mice perform a sound-generating forelimb movement and measure neural responses to sounds that violate an animal’s expectation in different ways. They find that predictions about self-generated sounds are highly specific across multiple stimulus dimensions and that a population of typically non-sound-responsive neurons respond to sounds that violate an animal’s expectation in a specific way. These results identify specific prediction error signals in the mouse auditory cortex and suggest that errors may be calculated early in sensory processing.

Hierarchy of prediction errors shapes the learning of context-dependent sensory representations

Learning prediction error neurons in a canonical interneuron circuit

Cooperative thalamocortical circuit mechanism for sensory prediction errors

Posteromedial cortical networks encode visuomotor prediction errors.

Predictive learning shapes the representational geometry of the human brain

Learning within a sensory-motor circuit links action to expected outcome

Learned response dynamics reflect stimulus timing and encode temporal expectation violations in superficial layers of mouse V1

Hierarchical Learning Induces Two Simultaneous, But Separable, Prediction Errors in Human Basal Ganglia

High-level visual prediction errors in early visual cortex

Unsigned temporal difference errors in cortical L5 dendrites during learning

Building and Breaking the Chain: A Model of Reward Prediction Error Integration and Segmentation of Memory

Perirhinal cortex learns a predictive map of the task environment

Model-based and model-free leaning by striatal neurons

Dopamine neuron ensembles signal the content of sensory prediction errors

NMDA-driven dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways

Stimulus-dependent adjustment of reward prediction error in the midbrain

Stimulus-specific prediction error neurons in mouse auditory cortex

Uncertainty-modulated prediction errors in cortical microcircuits

Sensory History Drives Adaptive Neural Geometry in LP/Pulvinar-Prefrontal Cortex Circuits

Partially dissociable roles of the Orbitofrontal cortex and dorsal Hippocampus in context-dependent (hierarchical) reward predictions and contextual inference in learning

Dopaminergic prediction errors in the ventral tegmental area reflect a multithreaded predictive model