Abstract:One of the key problems the brain faces is inferring the state of the world from a sequence of dynamically changing stimuli, and it is not yet clear how the sensory system achieves this task. A well-established computational framework for describing perceptual processes in the brain is provided by the theory of predictive coding. Although the original proposals of predictive coding have discussed temporal prediction, later work developing this theory mostly focused on static stimuli, and key questions on neural implementation and computational properties of temporal predictive coding networks remain open. Here, we address these questions and present a formulation of the temporal predictive coding model that can be naturally implemented in recurrent networks, in which activity dynamics rely only on local inputs to the neurons, and learning only utilises local Hebbian plasticity. Additionally, we show that temporal predictive coding networks can approximate the performance of the Kalman filter in predicting behaviour of linear systems, and behave as a variant of a Kalman filter which does not track its own subjective posterior variance. Importantly, temporal predictive coding networks can achieve similar accuracy as the Kalman filter without performing complex mathematical operations, but just employing simple computations that can be implemented by biological networks. Moreover, when trained with natural dynamic inputs, we found that temporal predictive coding can produce Gabor-like, motion-sensitive receptive fields resembling those observed in real neurons in visual areas. In addition, we demonstrate how the model can be effectively generalized to nonlinear systems. Overall, models presented in this paper show how biologically plausible circuits can predict future stimuli and may guide research on understanding specific neural circuits in brain areas involved in temporal prediction.

HTM-MAT: An online prediction software toolbox based on cortical machine learning algorithm

Continuous Online Sequence Learning with an Unsupervised Neural Network Model

Sequence learning, prediction, and replay in networks of spiking neurons

Performance Comparison of Different HTM-Spatial Pooler Algorithms Based on Information-Theoretic Measures

Memory-and-Anticipation Transformer for Online Action Understanding

Real-time Forecasting of Time Series in Financial Markets Using Sequentially Trained Many-to-one LSTMs

Learning Successor Features with Distributed Hebbian Temporal Memory

Improved Hierarchical Temporal Memory for Online Prediction of Ocean Time Series Data

Predictive Coding Networks for Temporal Prediction

Toward a Universal Cortical Algorithm: Examining Hierarchical Temporal Memory in Light of Frontal Cortical Function

Robust Real-Time Mortality Prediction in the Intensive Care Unit using Temporal Difference Learning

HAT: History-Augmented Anchor Transformer for Online Temporal Action Localization

A Neural Network Model For A Hierarchical Spatio-Temporal Memory

Making Good on LSTMs' Unfulfilled Promise

Hierarchical Temporal Memory method for time-series-based anomaly detection

Architecture of a Cortex Inspired Hierarchical Event Recaller

A complementary learning systems approach to temporal difference learning

Test Time Learning for Time Series Forecasting

Data-Driven Predictive Modeling of Neuronal Dynamics using Long Short-Term Memory

HirMTL: Hierarchical Multi-Task Learning for dense scene understanding