Abstract:This review explores the intersection of bio-plausible artificial intelligence in the form of Spiking Neural Networks (SNNs) with the analog In-Memory Computing (IMC) domain, highlighting their collective potential for low-power edge computing environments. Through detailed investigation at the device, circuit, and system levels, we highlight the pivotal synergies between SNNs and IMC architectures. Additionally, we emphasize the critical need for comprehensive system-level analyses, considering the inter-dependencies between algorithms, devices, circuit & system parameters, crucial for optimal performance. An in-depth analysis leads to identification of key system-level bottlenecks arising from device limitations which can be addressed using SNN-specific algorithm-hardware co-design techniques. This review underscores the imperative for holistic device to system design space co-exploration, highlighting the critical aspects of hardware and algorithm research endeavors for low-power neuromorphic solutions.

What problem does this paper attempt to address?

The main problem this paper attempts to address is the combination of biologically interpretable forms of artificial intelligence—Spiking Neural Networks (SNNs)—with In-Memory Computing (IMC) to achieve efficient computation in low-power edge computing environments. Specifically, the paper explores the synergy between SNNs and IMC architectures through detailed studies at the device, circuit, system, and algorithm levels, emphasizing the importance of comprehensive system analysis across these levels to optimize performance. Additionally, the paper identifies key system-level bottlenecks caused by device limitations and proposes SNN-specific algorithm-hardware co-design techniques to address these issues. ### Main Problem Summary: 1. **Low-Power Edge Computing**: How to leverage the combination of SNNs and IMC to achieve low-power, efficient edge computing. 2. **System-Level Co-Design**: How to conduct comprehensive analysis and co-design at the device, circuit, system, and algorithm levels to optimize the performance of SNNs on IMC platforms. 3. **Key Bottleneck Identification**: How to identify and address system-level bottlenecks caused by device limitations to improve the energy efficiency and performance of SNNs on IMC platforms. ### Background and Motivation: - **Development of Artificial Intelligence**: Over the past 10 years, AI algorithms such as deep convolutional neural networks and Transformers have made significant progress, but these algorithms rely on high-power server-grade computing devices (e.g., GPUs), leading to increased operational costs and a larger carbon footprint. - **Low-Power Demand**: To achieve more widespread and user-centric AI applications, it is necessary to develop low-power AI algorithms and hardware accelerators. - **Advantages of Spiking Neural Networks**: SNNs have sparse event-driven binary processing capabilities suitable for low-power edge computing and have been widely applied in fields such as image classification, optimization, agriculture, and autonomous driving. - **Advantages of In-Memory Computing**: IMC achieves analog dot product operations through non-volatile memory, reducing the bottleneck of weight data movement and improving energy and area efficiency. ### Research Methods and Contributions: - **Multi-Level Analysis**: Comprehensive analysis of the synergy between SNNs and IMC from the device, circuit, system, and algorithm levels. - **Bottleneck Identification**: Identification of key system-level bottlenecks caused by device limitations. - **Co-Design Strategies**: Proposal of SNN-specific algorithm-hardware co-design techniques to overcome these bottlenecks. - **Future Directions**: Discussion of key issues in SNN-IMC research, including device and system parameters for sustainable online learning. ### Conclusion: Through detailed analysis and experiments, the paper demonstrates the great potential of combining SNNs and IMC in low-power edge computing and proposes specific strategies and future research directions to achieve this goal.

When In-memory Computing Meets Spiking Neural Networks -- A Perspective on Device-Circuit-System-and-Algorithm Co-design

A Survey of Neuromorphic Computing Based on Spiking Neural Networks

Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

Sparsity-Aware In-Memory Neuromorphic Computing Unit With Configurable Topology of Hybrid Spiking and Artificial Neural Network

Hardware/Software co-design with ADC-Less In-memory Computing Hardware for Spiking Neural Networks

Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology

Spiking Neural Network Integrated Circuits: A Review of Trends and Future Directions

Bottom-Up and Top-Down Approaches for the Design of Neuromorphic Processing Systems: Tradeoffs and Synergies Between Natural and Artificial Intelligence

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence

Advanced Computing and Related Applications Leveraging Brain-inspired Spiking Neural Networks

Low-Power Neuromorphic Hardware for Signal Processing Applications

Modelling Spiking Neural Network from the Architecture Evaluation Perspective

Advances in Neuromorphic Computing: Expanding Horizons for AI Development through Novel Artificial Neurons and In-Sensor Computing

Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computing

To Spike or Not To Spike: A Digital Hardware Perspective on Deep Learning Acceleration

Neuromorphic Engineering: From Biological to Spike‐Based Hardware Nervous Systems

Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain

A Review of Spiking Neural Networks