Abstract:SNNs are an active research domain towards energy efficient machine intelligence. Compared to conventional ANNs, SNNs use temporal spike data and bio-plausible neuronal activation functions such as Leaky-Integrate Fire/Integrate Fire (LIF/IF) for data processing. However, SNNs incur significant dot-product operations causing high memory and computation overhead in standard von-Neumann computing platforms. Today, In-Memory Computing (IMC) architectures have been proposed to alleviate the "memory-wall bottleneck" prevalent in von-Neumann architectures. Although recent works have proposed IMC-based SNN hardware accelerators, the following have been overlooked- 1) the adverse effects of crossbar non-ideality on SNN performance due to repeated analog dot-product operations over multiple time-steps, 2) hardware overheads of essential SNN-specific components such as the LIF/IF and data communication modules. To this end, we propose SpikeSim, a tool that can perform realistic performance, energy, latency and area evaluation of IMC-mapped SNNs. SpikeSim consists of a practical monolithic IMC architecture called SpikeFlow for mapping SNNs. Additionally, the non-ideality computation engine (NICE) and energy-latency-area (ELA) engine performs hardware-realistic evaluation of SpikeFlow-mapped SNNs. Based on 65nm CMOS implementation and experiments on CIFAR10, CIFAR100 and TinyImagenet datasets, we find that the LIF/IF neuronal module has significant area contribution (>11% of the total hardware area). We propose SNN topological modifications leading to 1.24x and 10x reduction in the neuronal module's area and the overall energy-delay-product value, respectively. Furthermore, in this work, we perform a holistic comparison between IMC implemented ANN and SNNs and conclude that lower number of time-steps are the key to achieve higher throughput and energy-efficiency for SNNs compared to 4-bit ANNs.

To Spike or Not to Spike? A Quantitative Comparison of SNN and CNN FPGA Implementations

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

Spiking Neural Network Implementation on FPGA for Multiclass Classification

Enabling Efficient On-Edge Spiking Neural Network Acceleration with Highly Flexible FPGA Architectures

A Low Power and Low Latency FPGA-Based Spiking Neural Network Accelerator

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

A Survey of Spiking Neural Network Accelerator on FPGA

Comparison and Selection of Spike Encoding Algorithms for SNN on FPGA.

An Efficient Spiking Neural Network Accelerator with Sparse Weight.

A Convolutional Spiking Neural Network Accelerator with the Sparsity-Aware Memory and Compressed Weights

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

Hardware implementation of spiking neural networks on FPGA

A TTFS-based energy and utilization efficient neuromorphic CNN accelerator

SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

SPAT: FPGA-based Sparsity-Optimized Spiking Neural Network Training Accelerator with Temporal Parallel Dataflow

A Little Energy Goes a Long Way: Build an Energy-Efficient, Accurate Spiking Neural Network From Convolutional Neural Network

Boosting Throughput and Efficiency of Hardware Spiking Neural Accelerators using Time Compression Supporting Multiple Spike Codes

An Event-driven Spiking Neural Network Accelerator with On-chip Sparse Weight

Exploring the Sparsity-Quantization Interplay on a Novel Hybrid SNN Event-Driven Architecture