Abstract:SNNs are an active research domain towards energy efficient machine intelligence. Compared to conventional ANNs, SNNs use temporal spike data and bio-plausible neuronal activation functions such as Leaky-Integrate Fire/Integrate Fire (LIF/IF) for data processing. However, SNNs incur significant dot-product operations causing high memory and computation overhead in standard von-Neumann computing platforms. Today, In-Memory Computing (IMC) architectures have been proposed to alleviate the "memory-wall bottleneck" prevalent in von-Neumann architectures. Although recent works have proposed IMC-based SNN hardware accelerators, the following have been overlooked- 1) the adverse effects of crossbar non-ideality on SNN performance due to repeated analog dot-product operations over multiple time-steps, 2) hardware overheads of essential SNN-specific components such as the LIF/IF and data communication modules. To this end, we propose SpikeSim, a tool that can perform realistic performance, energy, latency and area evaluation of IMC-mapped SNNs. SpikeSim consists of a practical monolithic IMC architecture called SpikeFlow for mapping SNNs. Additionally, the non-ideality computation engine (NICE) and energy-latency-area (ELA) engine performs hardware-realistic evaluation of SpikeFlow-mapped SNNs. Based on 65nm CMOS implementation and experiments on CIFAR10, CIFAR100 and TinyImagenet datasets, we find that the LIF/IF neuronal module has significant area contribution (>11% of the total hardware area). We propose SNN topological modifications leading to 1.24x and 10x reduction in the neuronal module's area and the overall energy-delay-product value, respectively. Furthermore, in this work, we perform a holistic comparison between IMC implemented ANN and SNNs and conclude that lower number of time-steps are the key to achieve higher throughput and energy-efficiency for SNNs compared to 4-bit ANNs.

SpikingSIM: A Bio-Inspired Spiking Simulator.

SCSim: A Realistic Spike Cameras Simulator

NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic Cameras

SpikeNC: an Accurate and Scalable Simulator for Spiking Neural Network on Multi-Core Neuromorphic Hardware

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Spike Camera Image Reconstruction Using Deep Spiking Neural Networks

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Retina-Like Visual Image Reconstruction Via Spiking Neural Model

SIMONE: A Realistic Neural Network Simulator to Reproduce MEA-Based Recordings

SpikeNVS: Enhancing Novel View Synthesis from Blurry Images via Spike Camera

Spike-NeRF: Neural Radiance Field Based On Spike Camera

SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

Real-Time Generation of Hyperbolic Neuronal Spiking Patterns

SPAIC: A Spike-Based Artificial Intelligence Computing Framework

Joint Demosaicing and Denoising for Spike Camera

Algorithms for Fast Spiking Neural Network Simulation on FPGAs

Real-Time Cortical Simulation on Neuromorphic Hardware

SuperNeuro: A Fast and Scalable Simulator for Neuromorphic Computing

Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks

Neural Camera Simulators

SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks