Abstract:Spiking neural networks (SNNs) based on the leaky integrate and fire (LIF) model have been applied to energy-efficient temporal and spatiotemporal processing tasks. Due to the bioplausible neuronal dynamics and simplicity, LIF-SNN benefits from event-driven processing, however, usually face the embarrassment of reduced performance. This may because, in LIF-SNN, the neurons transmit information via spikes. To address this issue, in this work, we propose a leaky integrate and analog fire (LIAF) neuron model so that analog values can be transmitted among neurons, and a deep network termed LIAF-Net is built on it for efficient spatiotemporal processing. In the temporal domain, LIAF follows the traditional LIF dynamics to maintain its temporal processing capability. In the spatial domain, LIAF is able to integrate spatial information through convolutional integration or fully connected integration. As a spatiotemporal layer, LIAF can also be used with traditional artificial neural network (ANN) layers jointly. In addition, the built network can be trained with backpropagation through time (BPTT) directly, which avoids the performance loss caused by ANN to SNN conversion. Experiment results indicate that LIAF-Net achieves comparable performance to the gated recurrent unit (GRU) and long short-term memory (LSTM) on bAbI question answering (QA) tasks and achieves state-of-the-art performance on spatiotemporal dynamic vision sensor (DVS) data sets, including MNIST-DVS, CIFAR10-DVS, and DVS128 Gesture, with much less number of synaptic weights and computational overhead compared with traditional networks built by LSTM, GRU, convolutional LSTM (ConvLSTM), or 3-D convolution (Conv3D). Compared with traditional LIF-SNN, LIAF-Net also shows dramatic accuracy gain on all these experiments. In conclusion, LIAF-Net provides a framework combining the advantages of both ANNs and SNNs for lightweight and efficient spatiotemporal information processing.

A Computational Friendly Improved LIF Model Considering Refractory Period

IM-LIF: Improved Neuronal Dynamics with Attention Mechanism for Direct Training Deep Spiking Neural Network

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Reconstruction of Adaptive Leaky Integrate-and-Fire Neuron to Enhance the Spiking Neural Networks Performance by Establishing Complex Dynamics

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

A Spike-Based Model of Neuronal Intrinsic Plasticity.

Memristive leaky integrate-and-fire neuron and learnable straight-through estimator in spiking neural networks

LIAF-Net: Leaky Integrate and Analog Fire Network for Lightweight and Efficient Spatiotemporal Information Processing

CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

ARLIF: A Flexible and Efficient Recurrent Neuronal Model for Sequential Tasks.

TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling

Understanding the Functional Roles of Modelling Components in Spiking Neural Networks

Spiking Deep Residual Networks.

Linear Leakage: Better Robustness for Spiking Neural Network

A 5.37-TSOPS/W Reconfigurable Neuron Array with Dual-mode Neurons and Asynchronous Synapses for Energy-Efficient Inference and Biological Neural Network Simulation

Intralayer-Connected Spiking Neural Network with Hybrid Training Using Backpropagation and Probabilistic Spike-Timing Dependent Plasticity

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

PRF: Parallel Resonate and Fire Neuron for Long Sequence Learning in Spiking Neural Networks

Efficient Online Learning for Networks of Two-Compartment Spiking Neurons

GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks