Abstract:The timing of individual neuronal spikes is essential for biological brains to make fast responses to sensory stimuli. However, conventional artificial neural networks lack the intrinsic temporal coding ability present in biological networks. We propose a spiking neural network model that encodes information in the relative timing of individual neuron spikes. In classification tasks, the output of the network is indicated by the first neuron to spike in the output layer. This temporal coding scheme allows the supervised training of the network with backpropagation, using locally exact derivatives of the postsynaptic spike times with respect to presynaptic spike times. The network operates using a biologically-plausible alpha synaptic transfer function. Additionally, we use trainable synchronisation pulses that provide bias, add flexibility during training and exploit the decay part of the alpha function. We show that such networks can be trained successfully on noisy Boolean logic tasks and on the MNIST dataset encoded in time. The results show that the spiking neural network outperforms comparable spiking models on MNIST and achieves similar quality to fully connected conventional networks with the same architecture. We also find that the spiking network spontaneously discovers two operating regimes, mirroring the accuracy-speed trade-off observed in human decision-making: a slow regime, where a decision is taken after all hidden neurons have spiked and the accuracy is very high, and a fast regime, where a decision is taken very fast but the accuracy is lower. These results demonstrate the computational power of spiking networks with biological characteristics that encode information in the timing of individual neurons. By studying temporal coding in spiking networks, we aim to create building blocks towards energy-efficient and more complex biologically-inspired neural architectures.

Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Spike-driven Multi-Scale Learning with Hybrid Mechanisms of Spiking Dendrites.

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

MT-Spike: A Multilayer Time-based Spiking Neuromorphic Architecture with Temporal Error Backpropagation

A Hierarchical Organized Memory Model Using Spiking Neurons

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling

Flexible and Scalable Deep Dendritic Spiking Neural Networks with Multiple Nonlinear Branching

Computing of temporal information in spiking neural networks with ReRAM synapses

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Temporal Encoding and Multispike Learning Framework for Efficient Recognition of Visual Patterns.

The Role of Temporal Hierarchy in Spiking Neural Networks

A Temporal Signal-Processing Circuit Based on Spiking Neuron and Synaptic Learning

A Hybrid Learning Framework for Deep Spiking Neural Networks with One-Spike Temporal Coding

Advancing Spatio-Temporal Processing in Spiking Neural Networks through Adaptation