Abstract:Spiking neural networks (SNNs), which are a form of neuromorphic, brain-inspired AI, have the potential to be a power-efficient alternative to artificial neural networks (ANNs). Spikes that occur in SNN systems, also known as activations, tend to be extremely sparse, and low in number. This minimizes the number of data accesses typically needed for processing. In addition, SNN systems are typically designed to use addition operations which consume much less energy than the typical multiply and accumulate operations used in DNN systems. The vast majority of neuromorphic hardware designs support rate-based SNNs, where the information is encoded by spike rates. Generally, rate-based SNNs can be inefficient as a large number of spikes will be transmitted and processed during inference. One coding scheme that has the potential to improve efficiency is the time-to-first-spike (TTFS) coding, where the information isn't presented through the frequency of spikes, but instead through the relative spike arrival time. In TTFS-based SNNs, each neuron can only spike once during the entire inference process, and this results in high sparsity. The activation sparsity of TTFS-based SNNs is higher than rate-based SNNs, but TTFS-based SNNs have yet to achieve the same accuracy as rate-based SNNs. In this work, we propose two key improvements for TTFS-based SNN systems: (1) a novel optimization algorithm to improve the accuracy of TTFS-based SNNs and (2) a novel hardware accelerator for TTFS-based SNNs that uses a scalable and low-power design. Our work in TTFS coding and training improves the accuracy of TTFS-based SNNs to achieve state-of-the-art results on the MNIST and Fashion-MNIST datasets. Meanwhile, our work reduces the power consumption by at least 2.4×, 25.9×, and 38.4× over the state-of-the-art neuromorphic hardware on MNIST, Fashion-MNIST, and CIFAR10, respectively.

An Energy Efficient Residual Spiking Neural Network Accelerator with Ternary Spikes

Deep Spiking Neural Network with Ternary Spikes

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

An Energy-Efficient Spiking Neural Network Accelerator Based on Spatio-Temporal Redundancy Reduction

A TTFS-based energy and utilization efficient neuromorphic CNN accelerator

Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks

MF-DSNN:An Energy-efficient High-performance Multiplication-free Deep Spiking Neural Network Accelerator

A Reconfigurable FPGA-based Spiking Neural Network Accelerator

PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency

Spiking Deep Residual Networks.

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

A 67.5μJ/Prediction Accelerator for Spiking Neural Networks in Image Segmentation

Memristor Based Spiking Neural Network Accelerator Architecture

A Time-to-first-spike Coding and Conversion Aware Training for Energy-Efficient Deep Spiking Neural Network Processor Design

A Convolutional Spiking Neural Network Accelerator with the Sparsity-Aware Memory and Compressed Weights

Reconsidering the energy efficiency of spiking neural networks

A 0.67-to-5.4 TSOPs/W Spiking Neural Network Accelerator with 128/256 Reconfigurable Neurons and Asynchronous Fully Connected Synapses

An Efficient Spiking Neural Network Accelerator with Sparse Weight.