Abstract:How physical networks of neurons, bound by spatio-temporal locality constraints, can perform efficient credit assignment, remains, to a large extent, an open question. In machine learning, the answer is almost universally given by the error backpropagation algorithm, through both space and time. However, this algorithm is well-known to rely on biologically implausible assumptions, in particular with respect to spatio-temporal (non-)locality. Alternative forward-propagation models such as real-time recurrent learning only partially solve the locality problem, but only at the cost of scaling, due to prohibitive storage requirements. We introduce Generalized Latent Equilibrium (GLE), a computational framework for fully local spatio-temporal credit assignment in physical, dynamical networks of neurons. We start by defining an energy based on neuron-local mismatches, from which we derive both neuronal dynamics via stationarity and parameter dynamics via gradient descent. The resulting dynamics can be interpreted as a real-time, biologically plausible approximation of backpropagation through space and time in deep cortical networks with continuous-time neuronal dynamics and continuously active, local synaptic plasticity. In particular, GLE exploits the morphology of dendritic trees to enable more complex information storage and processing in single neurons, as well as the ability of biological neurons to phase-shift their output rate with respect to their membrane potential, which is essential in both directions of information propagation. For the forward computation, it enables the mapping of time-continuous inputs to neuronal space, effectively performing a spatio-temporal convolution. For the backward computation, it permits the temporal inversion of feedback signals, which consequently approximate the adjoint variables necessary for useful parameter updates.

Sparse Attentive Backtracking: Temporal CreditAssignment Through Reminding

Progressive Learning without Forgetting

STCA: Spatio-Temporal Credit Assignment with Delayed Feedback in Deep Spiking Neural Networks

Attention-Based Deep Spiking Neural Networks for Temporal Credit Assignment Problems.

Backpropagation through space, time, and the brain

Backpropagation through time learning for recurrence-aware long-term cognitive networks

Ensemble perspective for understanding temporal credit assignment

Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks

Efficient recurrent architectures through activity sparsity and sparse back-propagation through time

On extended long short-term memory and dependent bidirectional recurrent neural network

Long Short-Term Memory with Dynamic Skip Connections.

Biologically Plausible Training of Deep Neural Networks Using a Top-down Credit Assignment Network

S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks

Bio-inspired, task-free continual learning through activity regularization

A New Hierarchical Temporal Memory Based on Recurrent Learning Unit

A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost

Tree Memory Networks for Modelling Long-term Temporal Dependencies

Temporal-Difference Learning Using Distributed Error Signals

Enhancing spatiotemporal predictive learning: an approach with nested attention module

Spontaneous Temporal Grouping Neural Network for Long-Term Memory Modeling

Structural Credit Assignment with Coordinated Exploration