Abstract:Predictive coding is a leading theory of cortical function which posits that the brain continually makes predictions of incoming sensory stimuli using a hierarchical network of top-down and bottom-up connections. This theory is supported by prior work showing that PredNet, a deep learning network designed according to predictive coding principles, exhibits several characteristics of neural responses commonly observed in primate visual cortex. However, one ubiquitous neural phenomenon that has not yet been investigated is short-term visual adaptation: the adjustment of neural responses over time when exposed to static visual inputs that are either prolonged or directly repeated. Here, we examine whether PredNet exhibits two neural signatures of temporal adaptation previously observed in intracranial recordings of human participants viewing prolonged and repeated stimuli (Brands et al., 2024). We find that, like human visual cortex, PredNet adapts to static images, evidenced by subadditive temporal response summation: a non-linear accumulation of response magnitudes when prolonging stimulus durations, which results from neurally plausible transient-sustained dynamics in the unit activation time courses. However, PredNet activations also show a systematic response to stimulus offsets, which is absent in the human neural data. For repeated stimuli, PredNet shows slight response suppression for any two images presented in quick succession, but no repetition suppression, a comparatively stronger response reduction for identical than for non-identical image pairs that is robustly observed throughout human visual cortex. We show that these results are stable across multiple training datasets and two different types of loss computation. Lastly, in both PredNet and the neural data, we find a relationship between temporal adaptation and visual input properties, showing that temporally sustained activity is enhanced for more complex scenes containing clutter. All together, these results suggest that the emergent temporal dynamics in the PredNet only partly align with neural data and are linked to low-level properties of the visual input rather than high-level predictions arising from top-down processes.

Neural signatures of temporal anticipation in human cortex represent event probability density

Anticipatory brain activity depends on the sensory modality of the expected stimulus: insights from single-trial analyses

Neural networks representing temporal expectation in mice

The modulation of event-related alpha rhythm during the time course of anticipation

Neural representations of predicted events: Evidence from time-resolved EEG decoding

Simple Human Response Times are Governed by Dual Anticipatory Processes with Distinct and Distributed Neural Signatures

Temporal expectations modulate coupling between frontal and sensory brain areas

Sequential Temporal Anticipation Characterized by Neural Power Modulation and in Recurrent Neural Networks

Temporal Prediction through Integration of Probability Distributions of Event Timings at Multiple Levels

A nonlinear code for event probability in the human brain

Fluctuations in alpha and beta power provide neural states favourable for contextually relevant anticipatory processes

Predictable and unpredictable deviance detection in the human hippocampus and amygdala

A neural signature for the subjective experience of threat anticipation under uncertainty

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

The brain hierarchically represents the past and future during multistep anticipation

Intracranial Recordings and Computational Modeling of Music Reveal the Time Course of Prediction Error Signaling in Frontal and Temporal Cortices

Cerebellar encoding of prior knowledge of temporal statistics

Pre-stimulus alpha oscillations encode stimulus-specific visual predictions

Temporal Expectation Hastens Decision Onset But Does Not Affect Evidence Quality

Deep predictive coding networks partly capture neural signatures of short-term temporal adaptation in human visual cortex

Anticipated moments: temporal structure in attention