Abstract:Spiking neural networks (SNNs) based on the leaky integrate and fire (LIF) model have been applied to energy-efficient temporal and spatiotemporal processing tasks. Due to the bioplausible neuronal dynamics and simplicity, LIF-SNN benefits from event-driven processing, however, usually face the embarrassment of reduced performance. This may because, in LIF-SNN, the neurons transmit information via spikes. To address this issue, in this work, we propose a leaky integrate and analog fire (LIAF) neuron model so that analog values can be transmitted among neurons, and a deep network termed LIAF-Net is built on it for efficient spatiotemporal processing. In the temporal domain, LIAF follows the traditional LIF dynamics to maintain its temporal processing capability. In the spatial domain, LIAF is able to integrate spatial information through convolutional integration or fully connected integration. As a spatiotemporal layer, LIAF can also be used with traditional artificial neural network (ANN) layers jointly. In addition, the built network can be trained with backpropagation through time (BPTT) directly, which avoids the performance loss caused by ANN to SNN conversion. Experiment results indicate that LIAF-Net achieves comparable performance to the gated recurrent unit (GRU) and long short-term memory (LSTM) on bAbI question answering (QA) tasks and achieves state-of-the-art performance on spatiotemporal dynamic vision sensor (DVS) data sets, including MNIST-DVS, CIFAR10-DVS, and DVS128 Gesture, with much less number of synaptic weights and computational overhead compared with traditional networks built by LSTM, GRU, convolutional LSTM (ConvLSTM), or 3-D convolution (Conv3D). Compared with traditional LIF-SNN, LIAF-Net also shows dramatic accuracy gain on all these experiments. In conclusion, LIAF-Net provides a framework combining the advantages of both ANNs and SNNs for lightweight and efficient spatiotemporal information processing.

Sharing Leaky-Integrate-and-Fire Neurons for Memory-Efficient Spiking Neural Networks

IM-LIF: Improved Neuronal Dynamics with Attention Mechanism for Direct Training Deep Spiking Neural Network

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

LIAF-Net: Leaky Integrate and Analog Fire Network for Lightweight and Efficient Spatiotemporal Information Processing

GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks

Memory-Efficient Reversible Spiking Neural Networks

Efficient Spiking Neural Networks with Logarithmic Temporal Coding.

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

Memristive leaky integrate-and-fire neuron and learnable straight-through estimator in spiking neural networks

CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks

Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks

Reconstruction of Adaptive Leaky Integrate-and-Fire Neuron to Enhance the Spiking Neural Networks Performance by Establishing Complex Dynamics

Memristor-based Deep Spiking Neural Network with a Computing-In-Memory Architecture

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Efficient Spiking Neural Networks with Biologically Similar Lithium-Ion Memristor Neurons

Highly efficient neuromorphic learning system of spiking neural network with multi-compartment leaky integrate-and-fire neurons

SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost

Efficient Online Learning for Networks of Two-Compartment Spiking Neurons