Abstract:A fundamental function of cortical circuits is the integration of information from different sources to form a reliable basis for behavior. While animals behave as if they optimally integrate information according to Bayesian probability theory, the implementation of the required computations in the biological substrate remains unclear. We propose a novel, Bayesian view on the dynamics of conductance-based neurons and synapses which suggests that they are naturally equipped to optimally perform information integration. In our approach apical dendrites represent prior expectations over somatic potentials, while basal dendrites represent likelihoods of somatic potentials. These are parametrized by local quantities, the effective reversal potentials and membrane conductances. We formally demonstrate that under these assumptions the somatic compartment naturally computes the corresponding posterior. We derive a gradient-based plasticity rule, allowing neurons to learn desired target distributions and weight synaptic inputs by their relative reliabilities. Our theory explains various experimental findings on the system and single-cell level related to multi-sensory integration, which we illustrate with simulations. Furthermore, we make experimentally testable predictions on Bayesian dendritic integration and synaptic plasticity. The only certainty is uncertainty. Whether it is the reconstruction of a three-dimension scene from the two-dimensional images on our retina or locating your lock in twilight, we have to make decisions and perform actions without knowing the exact state of our environment. In the presence of uncertainty, Bayesian probability theory provides formal recipes of how different pieces of information should be combined to gain maximal information. Indeed, behavioral experiments show that humans and other animals behave as if they operate according to these principles. However, so far it is unclear how the necessary computations are implemented by our biological substrate. By suggesting a new view on the dynamics of a broad class of neuron models, we show how these computations may be implemented by individual cortical neurons. Furthermore, we derive a novel model of synaptic plasticity from first principles and illustrate how a neuron equipped with these synapse dynamics learns to approximate Bayes-optimal decision makers. Finally, we interpret various experimental results in light of our proposed theory and make experimentally testable predictions.

Dendritic cortical microcircuits approximate the backpropagation algorithm

Dendritic error backpropagation in deep cortical microcircuits

Single-phase deep learning in cortico-cortical networks

Learning efficient backprojections across cortical hierarchies in real time

Spike-driven Multi-Scale Learning with Hybrid Mechanisms of Spiking Dendrites.

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Challenging Backpropagation: Evidence for Target Learning in the Cortex

Using local plasticity rules to train recurrent neural networks

Learning cortical hierarchies with temporal Hebbian updates

Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain

Efficient dendritic learning as an alternative to synaptic plasticity hypothesis

A neuronal least-action principle for real-time learning in cortical circuits

Towards Biologically Plausible Deep Learning

Efficient Spike-Driven Learning With Dendritic Event-Based Processing

Approximating Back-propagation for a Biologically Plausible Local Learning Rule in Spiking Neural Networks

The brain as an efficient and robust adaptive learner

Towards deep learning with segregated dendrites

Backpropagation through space, time, and the brain

Conductance-based dendrites perform Bayes-optimal cue integration

Multi-compartment Structure Optimizes the Deep Learning Network from the Biophysical Perspective.