Abstract:In the past decade, advances in Artificial Neural Networks (ANNs) have allowed them to perform extremely well for a wide range of tasks. In fact, they have reached human parity when performing image recognition, for example. Unfortunately, the accuracy of these ANNs comes at the expense of a large number of cache and/or memory accesses and compute operations. Spiking Neural Networks (SNNs), a type of neuromorphic, or brain-inspired network, have recently gained significant interest as power-efficient alternatives to ANNs, because they are sparse, accessing very few weights, and typically only use addition operations instead of the more power-intensive multiply-and-accumulate (MAC) operations. The vast majority of neuromorphic hardware designs support rate-encoded SNNs, where the information is encoded in spike rates. Rate-encoded SNNs could be seen as inefficient as an encoding scheme because it involves the transmission of a large number of spikes. A more efficient encoding scheme, Time-To-First-Spike (TTFS) encoding, encodes information in the relative time of arrival of spikes. While TTFS-encoded SNNs are more efficient than rate-encoded SNNs, they have, up to now, performed poorly in terms of accuracy compared to previous methods. Hence, in this work, we aim to overcome the limitations of TTFS-encoded neuromorphic systems. To accomplish this, we propose: (1) a novel optimization algorithm for TTFS-encoded SNNs converted from ANNs and (2) a novel hardware accelerator for TTFS-encoded SNNs, with a scalable and low-power design. Overall, our work in TTFS encoding and training improves the accuracy of SNNs to achieve state-of-the-art results on MNIST MLPs, while reducing power consumption by 1.46$\times$ over the state-of-the-art neuromorphic hardware.

Optimizing Power Efficiency: Converting Recurrent Neural Networks to Spiking Neural Networks for Time-Domain Analysis

BitSNNs: Revisiting Energy-efficient Spiking Neural Networks

Efficient Structure Slimming for Spiking Neural Networks

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Towards Energy-Preserving Natural Language Understanding with Spiking Neural Networks

Optimized Potential Initialization for Low-latency Spiking Neural Networks

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

Towards High-performance Spiking Transformers from ANN to SNN Conversion

Energy-Efficient High-Accuracy Spiking Neural Network Inference Using Time-Domain Neurons

Training much deeper spiking neural networks with a small number of time-steps

Spiking Deep Residual Networks.

Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency

A Time-to-first-spike Coding and Conversion Aware Training for Energy-Efficient Deep Spiking Neural Network Processor Design

STCSNN: High energy efficiency spike-train level spiking neural networks with spatio-temporal conversion

Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy