Abstract:Spiking neural networks (SNNs) have garnered interest due to their energy efficiency and superior effectiveness on neuromorphic chips compared with traditional artificial neural networks (ANNs). One of the mainstream approaches to implementing deep SNNs is the ANN-SNN conversion, which integrates the efficient training strategy of ANNs with the energy-saving potential and fast inference capability of SNNs. However, under extreme low-latency conditions, the existing conversion theory suggests that the problem of misrepresentation of residual membrane potentials in SNNs, i.e., the inability of IF neurons with a reset-by-subtraction mechanism to respond to residual membrane potentials beyond the range from resting potential to threshold, leads to a performance gap in the converted SNNs compared to the original ANNs. This severely limits the possibility of practical application of SNNs on delay-sensitive edge devices. Existing conversion methods addressing this problem usually involve modifying the state of the conversion spiking neurons. However, these methods do not consider their adaptability and compatibility with neuromorphic chips. We propose a new approach based on explicit modeling of residual errors as additive noise. The noise is incorporated into the activation function of the source ANN, which effectively reduces the residual error. Our experiments on the CIFAR10/100 dataset verify that our approach exceeds the prevailing ANN-SNN conversion methods and directly trained SNNs concerning accuracy and the required time steps. Overall, our method provides new ideas for improving SNN performance under ultra-low-latency conditions and is expected to promote practical neuromorphic hardware applications for further development.

Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

Optimized Potential Initialization for Low-latency Spiking Neural Networks

A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing Rates.

Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimization

Symmetric-threshold ReLU for Fast and Nearly Lossless ANN-SNN Conversion

A New ANN-SNN Conversion Method with High Accuracy, Low Latency and Good Robustness

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

Faster and Stronger: When ANN-SNN Conversion Meets Parallel Spiking Calculation

Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes

Reducing ANN-SNN Conversion Error Through Residual Membrane Potential.

Spike Calibration: Bridging the Gap between ANNs and SNNs in ANN-SNN Conversion

High-accuracy deep ANN-to-SNN conversion using quantization-aware training framework and calcium-gated bipolar leaky integrate and fire neuron

A universal ANN-to-SNN framework for achieving high accuracy and low latency deep Spiking Neural Networks

Training-free Conversion of Pretrained ANNs to SNNs for Low-Power and High-Performance Applications

Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

Converting Artificial Neural Networks to Ultra-Low-Latency Spiking Neural Networks for Action Recognition

Optimal ANN-SNN Conversion with Group Neurons

SpikeConverter: an Efficient Conversion Framework Zipping the Gap Between Artificial Neural Networks and Spiking Neural Networks