Abstract:Recent strides in low-latency spiking neural network (SNN) algorithms have drawn significant interest, particularly due to their event-driven computing nature and fast inference capability. One of the most efficient ways to construct a low-latency SNN is by converting a pre-trained, low-bit artificial neural network (ANN) into an SNN. However, this conversion process faces two main challenges: First, converting SNNs from low-bit ANNs can lead to ``occasional noise" -- the phenomenon where occasional spikes are generated in spiking neurons where they should not be -- during inference, which significantly lowers SNN accuracy. Second, although low-latency SNNs initially show fast improvements in accuracy with time steps, these accuracy growths soon plateau, resulting in their peak accuracy lagging behind both full-precision ANNs and traditional ``long-latency SNNs'' that prioritize precision over speed. In response to these two challenges, this paper introduces a novel technique named ``noise adaptor.'' Noise adaptor can model occasional noise during training and implicitly optimize SNN accuracy, particularly at high simulation times $T$. Our research utilizes the ResNet model for a comprehensive analysis of the impact of the noise adaptor on low-latency SNNs. The results demonstrate that our method outperforms the previously reported quant-ANN-to-SNN conversion technique. We achieved an accuracy of 95.95\% within 4 time steps on CIFAR-10 using ResNet-18, and an accuracy of 74.37\% within 64 time steps on ImageNet using ResNet-50. Remarkably, these results were obtained without resorting to any noise correction methods during SNN inference, such as negative spikes or two-stage SNN simulations. Our approach significantly boosts the peak accuracy of low-latency SNNs, bringing them on par with the accuracy of full-precision ANNs. Code will be open source.

Error-Aware Conversion from ANN to SNN via Post-training Parameter Calibration

Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes

Spike Calibration: Bridging the Gap between ANNs and SNNs in ANN-SNN Conversion

A New ANN-SNN Conversion Method with High Accuracy, Low Latency and Good Robustness

Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks

Constructing Lightweight and Efficient Spiking Neural Networks for EEG-based Motor Imagery Classification

Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

A universal ANN-to-SNN framework for achieving high accuracy and low latency deep Spiking Neural Networks

High-accuracy deep ANN-to-SNN conversion using quantization-aware training framework and calcium-gated bipolar leaky integrate and fire neuron

Symmetric-threshold ReLU for Fast and Nearly Lossless ANN-SNN Conversion

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networks

Reducing ANN-SNN Conversion Error Through Residual Membrane Potential.

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

Toward a Lossless Conversion for Spiking Neural Networks with Negative-Spike Dynamics.

Optimal ANN-SNN Conversion with Group Neurons

Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimization

Training-free Conversion of Pretrained ANNs to SNNs for Low-Power and High-Performance Applications

Obtaining Optimal Spiking Neural Network in Sequence Learning via CRNN-SNN Conversion

Noise Adaptor in Spiking Neural Networks

Spike Calibration: Fast and Accurate Conversion of Spiking Neural Network for Object Detection and Segmentation