Abstract:Over the past several decades, backpropagation (BP) has played a critical role in the advancement of machine learning and remains a core method in numerous computational applications. It is also utilized extensively in comparative studies of biological and artificial neural network representations. Despite its widespread use, the implementation of BP in the brain remains elusive, and its biological plausibility is often questioned due to inherent issues such as the need for symmetry of weights between forward and backward connections, and the requirement of distinct forward and backward phases of computation. Here, we introduce a novel neuroplasticity rule that offers a potential mechanism for implementing BP in the brain. Similar in general form to the classical Hebbian rule, this rule is based on the core principles of maintaining the balance of excitatory and inhibitory inputs as well as on retrograde signaling, and operates over three progressively slower timescales: neural firing, retrograde signaling, and neural plasticity. We hypothesize that each neuron possesses an internal state, termed credit, in addition to its firing rate. After achieving equilibrium in firing rates, neurons receive credits based on their contribution to the E-I balance of postsynaptic neurons through retrograde signaling. As the network's credit distribution stabilizes, connections from those presynaptic neurons are strengthened that significantly contribute to the balance of postsynaptic neurons. We demonstrate mathematically that our learning rule precisely replicates BP in layered neural networks without any approximations. Simulations on artificial neural networks reveal that this rule induces varying community structures in networks, depending on the learning rate. This simple theoretical framework presents a biologically plausible implementation of BP, with testable assumptions and predictions that may be evaluated through biological experiments.

Gradient-adjusted Incremental Target Propagation Provides Effective Credit Assignment in Deep Neural Networks

GAIT-prop: A biologically plausible learning rule derived from backpropagation of error

Biologically Plausible Training of Deep Neural Networks Using a Top-down Credit Assignment Network

Optimization of Backpropagation Neural Network under the Adaptive Genetic Algorithm

Semi-Implicit Back Propagation.

Backpropagation through space, time, and the brain

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

Adaptive Bidirectional Backpropagation: Towards Biologically Plausible Error Signal Transmission in Neural Networks

Learning with Local Gradients at the Edge

Gradient-based inference of abstract task representations for generalization in neural networks

NDOT: Neuronal Dynamics-based Online Training for Spiking Neural Networks

Deep physical neural networks trained with backpropagation

Brain-like learning with exponentiated gradients

Activated Gradients for Deep Neural Networks

Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learning

Biologically-plausible learning algorithms can scale to large datasets

Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain

A Review of Neuroscience-Inspired Machine Learning

Contribute to balance, wire in accordance: Emergence of backpropagation from a simple, bio-plausible neuroplasticity rule

BP(λ): Online Learning via Synthetic Gradients