Abstract:Deep neural feedforward networks are effective models for a wide array of problems, but training and deploying such networks presents a significant energy cost. Spiking neural networks (SNNs), which are modeled after biologically realistic neurons, offer a potential solution when deployed correctly on neuromorphic computing hardware. Still, many applications train SNNs offline, and running network training directly on neuromorphic hardware is an ongoing research problem. The primary hurdle is that back-propagation, which makes training such artificial deep networks possible, is biologically implausible. Neuroscientists are uncertain about how the brain would propagate a precise error signal backward through a network of neurons. Recent progress addresses part of this question, e.g., the weight transport problem, but a complete solution remains intangible. In contrast, novel learning rules based on the information bottleneck (IB) train each layer of a network independently, circumventing the need to propagate errors across layers. Instead, propagation is implicit due the layers' feedforward connectivity. These rules take the form of a three-factor Hebbian update a global error signal modulates local synaptic updates within each layer. Unfortunately, the global signal for a given layer requires processing multiple samples concurrently, and the brain only sees a single sample at a time. We propose a new three-factor update rule where the global signal correctly captures information across samples via an auxiliary memory network. The auxiliary network can be trained a priori independently of the dataset being used with the primary network. We demonstrate comparable performance to baselines on image classification tasks. Interestingly, unlike back-propagation-like schemes where there is no link between learning and memory, our rule presents a direct connection between working memory and synaptic updates. To the best of our knowledge, this is the first rule to make this link explicit. We explore these implications in initial experiments examining the effect of memory capacity on learning performance. Moving forward, this work suggests an alternate view of learning where each layer balances memory-informed compression against task performance. This view naturally encompasses several key aspects of neural computation, including memory, efficiency, and locality.

Improving Learning Efficiency of Recurrent Neural Network Through Adjusting Weights of All Layers in a Biologically-Inspired Framework.

Information bottleneck-based Hebbian learning rule naturally ties working memory and synaptic updates

Using local plasticity rules to train recurrent neural networks

Efficient Reinforcement Learning of a Reservoir Network Model of Parametric Working Memory Achieved with a Cluster Population Winner-Take-all Readout Mechanism.

IM-LIF: Improved Neuronal Dynamics with Attention Mechanism for Direct Training Deep Spiking Neural Network

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Learning cortical hierarchies with temporal Hebbian updates

Learning to Modulate Random Weights: Neuromodulation-inspired Neural Networks For Efficient Continual Learning

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

Temporal Coding in Recurrent Spiking Neural Networks with Synaptic Delay-Weight Plasticity

Exploring weight initialization, diversity of solutions, and degradation in recurrent neural networks trained for temporal and decision-making tasks

Neuron-centric Hebbian Learning

A working memory model based on recurrent neural networks using reinforcement learning

Reinforcement Learning with Brain-Inspired Modulation can Improve Adaptation to Environmental Changes

Structured flexibility in recurrent neural networks via neuromodulation

A Supervised Learning Rule for Recurrent Spiking Neural Networks with Weighted Spikes.

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Learning efficient backprojections across cortical hierarchies in real time

A Study of Biologically Plausible Neural Network: The Role and Interactions of Brain-Inspired Mechanisms in Continual Learning

Biologically Inspired Heterogeneous Learning for Accurate, Efficient and Low-Latency Neural Network