Abstract:Predictive coding theories of sensory brain function interpret the hierarchical construction of the cerebral cortex as a Bayesian, generative model capable of predicting the sensory data consistent with any given percept. Predictions are fed backward in the hierarchy and reciprocated by prediction error in the forward direction, acting to modify the representation of the outside world at increasing levels of abstraction, and so to optimize the nature of perception over a series of iterations. This accounts for many 'illusory' instances of perception where what is seen (heard, etc.) is unduly influenced by what is expected, based on past experience. This simple conception, the hierarchical exchange of prediction and prediction error, confronts a rich cortical microcircuitry that is yet to be fully documented. This article presents the view that, in the current state of theory and practice, it is profitable to begin a two-way exchange: that predictive coding theory can support an understanding of cortical microcircuit function, and prompt particular aspects of future investigation, whilst existing knowledge of microcircuitry can, in return, influence theoretical development. As an example, a neural inference arising from the earliest formulations of predictive coding is that the source populations of forward and backward pathways should be completely separate, given their functional distinction; this aspect of circuitry - that neurons with extrinsically bifurcating axons do not project in both directions - has only recently been confirmed. Here, the computational architecture prescribed by a generalized (free-energy) formulation of predictive coding is combined with the classic 'canonical microcircuit' and the laminar architecture of hierarchical extrinsic connectivity to produce a template schematic, that is further examined in the light of (a) updates in the microcircuitry of primate visual cortex, and (b) rapid technical advances made possible by transgenic neural engineering in the mouse. The exercise highlights a number of recurring themes, amongst them the consideration of interneuron diversity as a spur to theoretical development and the potential for specifying a pyramidal neuron's function by its individual 'connectome,' combining its extrinsic projection (forward, backward or subcortical) with evaluation of its intrinsic network (e.g., unidirectional versus bidirectional connections with other pyramidal neurons).

Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?

Predictive Coding as a Neuromorphic Alternative to Backpropagation: A Critical Evaluation

Predictive Coding: a Theoretical and Experimental Review

A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks

Predictive Coding beyond Gaussian Distributions

Learning on Arbitrary Graph Topologies via Predictive Coding

Relaxing the Constraints on Predictive Coding Models

Predictive Coding Can Do Exact Backpropagation on Convolutional and Recurrent Neural Networks

On the relationship between predictive coding and backpropagation

Brain-Inspired Computational Intelligence via Predictive Coding

Hierarchical Predictive Coding Models in a Deep-Learning Framework

Predictive coding with spiking neurons and feedforward gist signaling

Predictive coding is a consequence of energy efficiency in recurrent neural networks

Neural Elements for Predictive Coding

Predictive Coding Networks for Temporal Prediction

Reverse Differentiation via Predictive Coding

Predictive Coding Networks and Inference Learning: Tutorial and Survey

Deep Predictive Coding with Bi-directional Propagation for Classification and Reconstruction

Predictive Coding beyond Correlations

Understanding and Improving Optimization in Predictive Coding Networks