Abstract:SNNs are an active research domain towards energy efficient machine intelligence. Compared to conventional ANNs, SNNs use temporal spike data and bio-plausible neuronal activation functions such as Leaky-Integrate Fire/Integrate Fire (LIF/IF) for data processing. However, SNNs incur significant dot-product operations causing high memory and computation overhead in standard von-Neumann computing platforms. Today, In-Memory Computing (IMC) architectures have been proposed to alleviate the "memory-wall bottleneck" prevalent in von-Neumann architectures. Although recent works have proposed IMC-based SNN hardware accelerators, the following have been overlooked- 1) the adverse effects of crossbar non-ideality on SNN performance due to repeated analog dot-product operations over multiple time-steps, 2) hardware overheads of essential SNN-specific components such as the LIF/IF and data communication modules. To this end, we propose SpikeSim, a tool that can perform realistic performance, energy, latency and area evaluation of IMC-mapped SNNs. SpikeSim consists of a practical monolithic IMC architecture called SpikeFlow for mapping SNNs. Additionally, the non-ideality computation engine (NICE) and energy-latency-area (ELA) engine performs hardware-realistic evaluation of SpikeFlow-mapped SNNs. Based on 65nm CMOS implementation and experiments on CIFAR10, CIFAR100 and TinyImagenet datasets, we find that the LIF/IF neuronal module has significant area contribution (>11% of the total hardware area). We propose SNN topological modifications leading to 1.24x and 10x reduction in the neuronal module's area and the overall energy-delay-product value, respectively. Furthermore, in this work, we perform a holistic comparison between IMC implemented ANN and SNNs and conclude that lower number of time-steps are the key to achieve higher throughput and energy-efficiency for SNNs compared to 4-bit ANNs.

SIAM: Chiplet-based Scalable In-Memory Acceleration with Mesh for Deep Neural Networks

DaDianNao: A Machine-Learning Supercomputer

INDM: Chiplet-Based Interconnect Network and Dataflow Mapping for DNN Accelerators

Benchmark of the Compute-in-Memory-Based DNN Accelerator With Area Constraint

DNN+NeuroSim V2.0: An End-to-End Benchmarking Framework for Compute-in-Memory Accelerators for On-chip Training

SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

Computing Utilization Enhancement for Chiplet-based Homogeneous Processing-in-Memory Deep Learning Processors

A Heterogeneous In-Memory Computing Cluster For Flexible End-to-End Inference of Real-World Deep Neural Networks

ASiM: Improving Transparency of SRAM-based Analog Compute-in-Memory Research with an Open-Source Simulation Framework

Energy-efficient SNN Architecture using 3nm FinFET Multiport SRAM-based CIM with Online Learning

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

Hybrid RRAM/SRAM in-Memory Computing for Robust DNN Acceleration

Benchmarking and modeling of analog and digital SRAM in-memory computing architectures

Bulk-Switching Memristor-Based Compute-In-Memory Module for Deep Neural Network Training

IMCE: Energy-efficient Bit-Wise In-Memory Convolution Engine for Deep Neural Network

On-Device Continual Learning with STT-Assisted-SOT MRAM Based In-Memory Computing

SpiDR: A Reconfigurable Digital Compute-in-Memory Spiking Neural Network Accelerator for Event-based Perception

Hadamard Product-Based In-Memory Computing Design for Floating Point Neural Network Training

Neural Networks on Chip: from CMOS Accelerators to In-Memory-Computing

NeuroSim V1.4: Extending Technology Support for Digital Compute-in-Memory Toward 1nm Node

DIMA: A Depthwise CNN In-Memory Accelerator