Abstract:The brain can efficiently learn a wide range of tasks, motivating the search for biologically inspired learning rules for improving current artificial intelligence technology. Most biological models are composed of point neurons and cannot achieve state-of-the-art performance in machine learning. Recent works have proposed that input segregation (neurons receive sensory information and higher-order feedback in segregated compartments), and nonlinear dendritic computation would support error backpropagation in biological neurons. However, these approaches require propagating errors with a fine spatiotemporal structure to all the neurons, which is unlikely to be feasible in a biological network. To relax this assumption, we suggest that bursts and dendritic input segregation provide a natural support for target-based learning, which propagates targets rather than errors. A coincidence mechanism between the basal and the apical compartments allows for generating high-frequency bursts of spikes. This architecture supports a burst-dependent learning rule, based on the comparison between the target bursting activity triggered by the teaching signal and the one caused by the recurrent connections, providing support for target-based learning. We show that this framework can be used to efficiently solve spatiotemporal tasks, such as context-dependent store and recall of three-dimensional trajectories, and navigation tasks. Finally, we suggest that this neuronal architecture naturally allows for orchestrating "hierarchical imitation learning", enabling the decomposition of challenging long-horizon decision-making tasks into simpler subtasks. We show a possible implementation of this in a two-level network, where the high network produces the contextual signal for the low network.

Spiking Perceptrons

A NOVEL SPIKING PERCEPTRON THAT CAN SOLVE XOR PROBLEM

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

A Spiking Neural Network System for Robust Sequence Recognition

Learning Real-World Stimuli by Single-Spike Coding and Tempotron Rule

A Spike-Timing Based Integrated Model for Pattern Recognition

Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons.

NbO2-based memristive neurons for burst-based perceptron

A Spiking Network for Inference of Relations Trained with Neuromorphic Backpropagation

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Deep Spiking Networks

Spike-based computation using classical recurrent neural networks

Spiking Neural Networks with Neurons Firing Multiple Spikes

A Tandem Learning Rule for Effective Training and Rapid Inference of Deep Spiking Neural Networks

Synaptic Learning with Augmented Spikes

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Training Spiking Neuronal Networks with Applications in Engineering Tasks.

Spiking representation learning for associative memories