Abstract:Spiking neural networks (SNNs) operating with asynchronous discrete events show higher energy efficiency with sparse computation. A popular approach for implementing deep SNNs is artificial neural network (ANN)-SNN conversion combining both efficient training of ANNs and efficient inference of SNNs. However, the accuracy loss is usually nonnegligible, especially under few time steps, which restricts the applications of SNN on latency-sensitive edge devices greatly. In this article, we first identify that such performance degradation stems from the misrepresentation of the negative or overflow residual membrane potential in SNNs. Inspired by this, we decompose the conversion error into three parts: quantization error, clipping error, and residual membrane potential representation error. With such insights, we propose a two-stage conversion algorithm to minimize those errors, respectively. In addition, we show that each stage achieves significant performance gains in a complementary manner. By evaluating on challenging datasets including CIFAR-10, CIFAR-100, and ImageNet, the proposed method demonstrates the state-of-the-art performance in terms of accuracy, latency, and energy preservation. Furthermore, our method is evaluated using a more challenging object detection task, revealing notable gains in regression performance under ultralow latency, when compared with existing spike-based detection algorithms. Codes will be available at: https://github.com/Windere/snn-cvt-dual-phase.

Improving Spiking Sparse Recovery via Non-Convex Penalties

Block-Sparse Signal Recovery Based on Adaptive Matching Pursuit Via Spike and Slab Prior

Robust Sparse Recovery Via Non-Convex Optimization

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Efficient Sparse Recovery Via Adaptive Non-Convex Regularizers with Oracle Property

Sparse Signal Recovery Via Minimax-Concave Penalty and ℓ 1 -Norm Loss Function.

Structured Sparsity Optimization with Non-Convex Surrogates of L2,0-Norm: A Unified Algorithmic Framework

Structured Sparsity Optimization with Non-Convex Surrogates of $\ell _{2,0}$ℓ2,0-Norm: A Unified Algorithmic Framework

From Least Squares to Sparse: A Non-Convex Approach with Guarantee

Efficient and Robust Recovery of Sparse Signal and Image Using Generalized Nonconvex Regularization

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Weakly Convex Regularized Robust Sparse Recovery Methods with Theoretical Guarantees

A Unified Primal Dual Active Set Algorithm for Nonconvex Sparse Recovery

Sparse Recovery Via Nonconvex Regularized M-estimators over ℓ_q-Balls

Adaptive matching pursuit for sparse signal recovery

Fast Sparse Recovery Via Non-Convex Optimization

A Fast Convex Conjugated Algorithm for Sparse Recovery