Abstract:Spiking Neural Networks (SNNs) have demonstrated capabilities for solving diverse machine learning tasks with ultra-low power/energy consumption. To maximize the performance and efficiency of SNN inference, the Compute-in-Memory (CIM) hardware accelerators with emerging device technologies (e.g., RRAM) have been employed. However, SNN architectures are typically developed without considering constraints from the application and the underlying CIM hardware, thereby hindering SNNs from reaching their full potential in accuracy and efficiency. To address this, we propose NeuroNAS, a novel framework for developing energy-efficient neuromorphic CIM systems using a hardware-aware spiking neural architecture search (NAS), i.e., by quickly finding an SNN architecture that offers high accuracy under the given constraints (e.g., memory, area, latency, and energy consumption). NeuroNAS employs the following key steps: (1) optimizing SNN operations to enable efficient NAS, (2) employing quantization to minimize the memory footprint, (3) developing an SNN architecture that facilitates an effective learning, and (4) devising a systematic hardware-aware search algorithm to meet the constraints. Compared to the state-of-the-art, NeuroNAS with 8bit weight precision quickly finds SNNs that maintain high accuracy by up to 6.6x search time speed-ups, while achieving up to 92% area savings, 1.2x latency speed-ups, 84% energy savings across CIFAR-10, CIFAR-100, and TinyImageNet-200 datasets; while the state-of-the-art fail to meet all constraints at once. In this manner, NeuroNAS enables efficient design automation in developing energy-efficient neuromorphic CIM systems for diverse ML-based applications.

Neural Architecture Search with In‐Memory Multiply–Accumulate and In‐Memory Rank Based on Coating Layer Optimized C‐Doped Ge2Sb2Te5 Phase Change Memory

DaDianNao: A Machine-Learning Supercomputer

Open-loop Analog Programmable Electrochemical Memory Array

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Phase-change Heterostructure Enables Ultralow Noise and Drift for Memory Operation.

Optimization of Projected Phase Change Memory for Analog In‐Memory Computing Inference (Adv. Electron. Mater. 6/2023)

An in-memory computing architecture based on two-dimensional semiconductors for multiply-accumulate operations

Multi-Objective Neural Architecture Search for In-Memory Computing

NeuroNAS: A Framework for Energy-Efficient Neuromorphic Compute-in-Memory Systems using Hardware-Aware Spiking Neural Architecture Search

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators

CMN: a co-designed neural architecture search for efficient computing-in-memory-based mixture-of-experts

In-Memory Computing Integrated Structure Circuit Based on Nonvolatile Flash Memory Unit

In-memory computing based on phase change memory for high energy efficiency

33.2 A Fully Integrated Analog ReRAM Based 78.4TOPS/W Compute-In-Memory Chip with Fully Parallel MAC Computing.

Efficient Discrete Temporal Coding Spike-Driven In-Memory Computing Macro for Deep Neural Network Based on Nonvolatile Memory.

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

In-memory Computing with Emerging Nonvolatile Memory Devices

An in-memory computing architecture based on a duplex two-dimensional material structure for in situ machine learning

Reconfigurable Multilevel Storage and Neuromorphic Computing Based on Multilayer Phase-Change Memory

Neural Networks on Chip: from CMOS Accelerators to In-Memory-Computing