Abstract:The timing of individual neuronal spikes is essential for biological brains to make fast responses to sensory stimuli. However, conventional artificial neural networks lack the intrinsic temporal coding ability present in biological networks. We propose a spiking neural network model that encodes information in the relative timing of individual neuron spikes. In classification tasks, the output of the network is indicated by the first neuron to spike in the output layer. This temporal coding scheme allows the supervised training of the network with backpropagation, using locally exact derivatives of the postsynaptic spike times with respect to presynaptic spike times. The network operates using a biologically-plausible alpha synaptic transfer function. Additionally, we use trainable synchronisation pulses that provide bias, add flexibility during training and exploit the decay part of the alpha function. We show that such networks can be trained successfully on noisy Boolean logic tasks and on the MNIST dataset encoded in time. The results show that the spiking neural network outperforms comparable spiking models on MNIST and achieves similar quality to fully connected conventional networks with the same architecture. We also find that the spiking network spontaneously discovers two operating regimes, mirroring the accuracy-speed trade-off observed in human decision-making: a slow regime, where a decision is taken after all hidden neurons have spiked and the accuracy is very high, and a fast regime, where a decision is taken very fast but the accuracy is lower. These results demonstrate the computational power of spiking networks with biological characteristics that encode information in the timing of individual neurons. By studying temporal coding in spiking networks, we aim to create building blocks towards energy-efficient and more complex biologically-inspired neural architectures.

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Learning recurrent dynamics in spiking networks

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

Temporal Coding in Recurrent Spiking Neural Networks with Synaptic Delay-Weight Plasticity

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Sequence learning, prediction, and replay in networks of spiking neurons

A Spike-Timing Based Integrated Model for Pattern Recognition

Spatial representation of temporal information through spike timing dependent plasticity

Unsupervised Learning of Spatio-Temporal Patterns in Spiking Neuronal Networks

Networks that learn the precise timing of event sequences

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Predictive learning by a burst-dependent learning rule

Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device

A Spiking Neural Network System for Robust Sequence Recognition

Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Learning Real-World Stimuli By Single-Spike Coding And Tempotron Rule

Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation