Abstract:A key driver of mammalian intelligence is the ability to represent incoming sensory information across multiple abstraction levels. For example, in the visual ventral stream, incoming signals are first represented as low-level edge filters and then transformed into high-level object representations. Similar hierarchical structures routinely emerge in artificial neural networks (ANNs) trained for object recognition tasks, suggesting that similar structures may underlie biological neural networks. However, the classical ANN training algorithm, backpropagation, is considered biologically implausible, and thus alternative biologically plausible training methods have been developed such as Equilibrium Propagation, Deep Feedback Control, Supervised Predictive Coding, and Dendritic Error Backpropagation. Several of those models propose that local errors are calculated for each neuron by comparing apical and somatic activities. Notwithstanding, from a neuroscience perspective, it is not clear how a neuron could compare compartmental signals. Here, we propose a solution to this problem in that we let the apical feedback signal change the postsynaptic firing rate and combine this with a differential Hebbian update, a rate-based version of classical spiking time-dependent plasticity (STDP). We prove that weight updates of this form minimize two alternative loss functions that we prove to be equivalent to the error-based losses used in machine learning: the inference latency and the amount of top-down feedback necessary. Moreover, we show that the use of differential Hebbian updates works similarly well in other feedback-based deep learning frameworks such as Predictive Coding or Equilibrium Propagation. Finally, our work removes a key requirement of biologically plausible models for deep learning and proposes a learning mechanism that would explain how temporal Hebbian learning rules can implement supervised hierarchical learning.

Learning to learn with backpropagation of Hebbian plasticity

Differentiable plasticity: training plastic neural networks with backpropagation

Neuron-centric Hebbian Learning

Inferring neural activity before plasticity as a foundation for learning beyond backpropagation

Hebbian and Gradient-based Plasticity Enables Robust Memory and Rapid Learning in RNNs

Using local plasticity rules to train recurrent neural networks

Learning predictive cognitive maps with spiking neurons during behavior and replays

Learning cortical hierarchies with temporal Hebbian updates

Memory-enriched computation and learning in spiking neural networks through Hebbian plasticity

Memory-Dependent Computation and Learning in Spiking Neural Networks Through Hebbian Plasticity

Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticity

Evolving Decomposed Plasticity Rules for Information-Bottlenecked Meta-Learning

Meta-learning biologically plausible plasticity rules with random feedback pathways

Evolving interpretable plasticity for spiking networks

SpikePropamine: Differentiable Plasticity in Spiking Neural Networks

A solution to the learning dilemma for recurrent networks of spiking neurons

Learning to Learn with Feedback and Local Plasticity

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Neuroplastic Expansion in Deep Reinforcement Learning

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks

Challenging Backpropagation: Evidence for Target Learning in the Cortex