Abstract:Successful perception depends on combining sensory input with prior knowledge. However, the underlying mechanism by which these two sources of information are combined is unknown. In speech perception, as in other domains, two functionally distinct coding schemes have been proposed for how expectations influence representation of sensory evidence. Traditional models suggest that expected features of the speech input are enhanced or sharpened via interactive activation (Sharpened Signals). Conversely, Predictive Coding suggests that expected features are suppressed so that unexpected features of the speech input (Prediction Errors) are processed further. The present work is aimed at distinguishing between these two accounts of how prior knowledge influences speech perception. By combining behavioural, univariate, and multivariate fMRI measures of how sensory detail and prior expectations influence speech perception with computational modelling, we provide evidence in favour of Prediction Error computations. Increased sensory detail and informative expectations have additive behavioural and univariate neural effects because they both improve the accuracy of word report and reduce the BOLD signal in lateral temporal lobe regions. However, sensory detail and informative expectations have interacting effects on speech representations shown by multivariate fMRI in the posterior superior temporal sulcus. When prior knowledge was absent, increased sensory detail enhanced the amount of speech information measured in superior temporal multivoxel patterns, but with informative expectations, increased sensory detail reduced the amount of measured information. Computational simulations of Sharpened Signals and Prediction Errors during speech perception could both explain these behavioural and univariate fMRI observations. However, the multivariate fMRI observations were uniquely simulated by a Prediction Error and not a Sharpened Signal model. The interaction between prior expectation and sensory detail provides evidence for a Predictive Coding account of speech perception. Our work establishes methods that can be used to distinguish representations of Prediction Error and Sharpened Signals in other perceptual domains.

Prediction errors lead to updating of memories for conversations

What Happened When? Cerebral Processing of Modified Structure and Content in Episodic Cueing

Differential Neural Correlates Underlie Judgment of Learning and Subsequent Memory Performance

Prediction error and memory across the lifespan

Prediction error determines how memories are organized in the brain

Same Same, But Different: Brain Areas Underlying the Learning from Repetitive Episodic Prediction Errors

Knowledge acquisition is governed by striatal prediction errors

Learning from imagined experiences via an endogenous prediction error

Motivation and prediction-driven processing of social memoranda

Prediction Errors for Aversive Events Shape Long-Term Memory Formation through a Distinct Neural Mechanism

Prediction Error and Event Segmentation in Episodic Memory

Understanding Impression Updating Through Behavior Predictions

Predictive influences on memory encoding: investigating oscillations and the N400 event-related potential component

Schema-driven prediction effects on episodic memory across the lifespan

Predictive learning shapes the representational geometry of the human brain

Prediction Errors but Not Sharpened Signals Simulate Multivoxel fMRI Patterns during Speech Perception

Building and Breaking the Chain: A Model of Reward Prediction Error Integration and Segmentation of Memory

Error-based Implicit Learning in Language: The Effect of Sentence Context and Constraint in a Repetition Paradigm

Convergent neural signatures of speech prediction error are a biological marker for spoken word recognition

Misinformation in social interaction: examining the role of discussion

Prediction error determines how memories are organized in the brain: a study of Pavlovian fear extinction in rats