Abstract:Spiking neural networks (SNNs) have received increasing attention due to their high biological plausibility and energy efficiency. The binary spike-based information propagation enables efficient sparse computation in event-based and static computer vision applications. However, the weight precision and especially the membrane potential precision remain as high-precision values (e.g., 32 bits) in state-of-the-art SNN algorithms. Each neuron in an SNN stores the membrane potential over time and typically updates its value in every time step. Such frequent read/write operations of high-precision membrane potential incur storage and memory access overhead in SNNs, which undermines the SNNs' compatibility with resource-constrained hardware. To resolve this inefficiency, prior works have explored the time step reduction and low-precision representation of membrane potential at a limited scale and reported significant accuracy drops. Furthermore, while recent advances in on-device AI present pruning and quantization optimization with different architectures and datasets, simultaneous pruning with quantization is highly under-explored in SNNs. In this work, we present SpQuant-SNN , a fully-quantized spiking neural network with ultra-low precision weights, membrane potential, and high spatial-channel sparsity , enabling the end-to-end low precision with significantly reduced operations on SNN. First, we propose an integer-only quantization scheme for the membrane potential with a stacked surrogate gradient function, a simple-yet-effective method that enables the smooth learning process of quantized SNN training. Second, we implement spatial-channel pruning with membrane potential prior, toward reducing the layer-wise computational complexity, and floating-point operations (FLOPs) in SNNs. Finally, to further improve the accuracy of low-precision and sparse SNN, we propose a self-adaptive learnable potential threshold for SNN training. Equipped with high biological adaptiveness, minimal computations, and memory utilization, SpQuant-SNN achieves state-of-the-art performance across multiple SNN models for both event-based and static image datasets, including both image classification and object detection tasks. The proposed SpQuant-SNN achieved up to 13× memory reduction and >4.7× FLOPs reduction with < 1.8% accuracy degradation for both classification and object detection tasks, compared to the SOTA baseline.

Quantized STDP-based online-learning spiking neural network

An Energy Efficient STDP-Based SNN Architecture With On-Chip Learning

SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training

Low Precision Quantization-aware Training in Spiking Neural Networks with Differentiable Quantization Function

RRAM-Based Spiking Neural Network with Target-Modulated Spike-Timing-Dependent Plasticity

ALBSNN: ultra-low latency adaptive local binary spiking neural network with accuracy loss estimator

Q-SNNs: Quantized Spiking Neural Networks

Ultra-low Latency Adaptive Local Binary Spiking Neural Network with Accuracy Loss Estimator

Weight Quantization Method for Spiking Neural Networks and Analysis of Adversarial Robustness

Deep Spiking Neural Networks with Binary Weights for Object Recognition

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

A 4096-Neuron 1M-Synapse 3.8-pJ/SOP Spiking Neural Network With On-Chip STDP Learning and Sparse Weights in 10-nm FinFET CMOS

Paired Competing Neurons Improving STDP Supervised Local Learning In Spiking Neural Networks

Stochastic Quantization for Learning Accurate Low-Bit Deep Neural Networks

A Fast Spiking Neural Network Accelerator based on BP-STDP Algorithm and Weighted Neuron Model

A Novel Conversion Method for Spiking Neural Network Using Median Quantization

Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization

Intralayer-Connected Spiking Neural Network with Hybrid Training Using Backpropagation and Probabilistic Spike-Timing Dependent Plasticity

Quantisation and Pooling Method for Low-Inference-latency Spiking Neural Networks

SpQuant-SNN: ultra-low precision membrane potential with sparse activations unlock the potential of on-device spiking neural networks applications

SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks