Abstract:Edge computing is a promising solution for handling high-dimensional, multispectral analog data from sensors and IoT devices for applications such as autonomous drones. However, edge devices' limited storage and computing resources make it challenging to perform complex predictive modeling at the edge. Compute-in-memory (CiM) has emerged as a principal paradigm to minimize energy for deep learning-based inference at the edge. Nevertheless, integrating storage and processing complicates memory cells and/or memory peripherals, essentially trading off area efficiency for energy efficiency. This paper proposes a novel solution to improve area efficiency in deep learning inference tasks. The proposed method employs two key strategies. Firstly, a Frequency domain learning approach uses binarized Walsh-Hadamard Transforms, reducing the necessary parameters for DNN (by 87% in MobileNetV2) and enabling compute-in-SRAM, which better utilizes parallelism during inference. Secondly, a memory-immersed collaborative digitization method is described among CiM arrays to reduce the area overheads of conventional ADCs. This facilitates more CiM arrays in limited footprint designs, leading to better parallelism and reduced external memory accesses. Different networking configurations are explored, where Flash, SA, and their hybrid digitization steps can be implemented using the memory-immersed scheme. The results are demonstrated using a 65 nm CMOS test chip, exhibiting significant area and energy savings compared to a 40 nm-node 5-bit SAR ADC and 5-bit Flash ADC. By processing analog data more efficiently, it is possible to selectively retain valuable data from sensors and alleviate the challenges posed by the analog data deluge.

Gradient descent-based programming of analog in-memory computing cores

Open-loop Analog Programmable Electrochemical Memory Array

Low-Rank Gradient Descent for Memory-Efficient Training of Deep In-Memory Arrays

Demonstration of 4-quadrant analog in-memory matrix multiplication in a single modulation

Towards Exact Gradient-based Training on Analog In-memory Computing

A 4-Bit Calibration-Free Computing-In-Memory Macro with 3T1C Current-Programed Dynamic-Cascode Multi-Level-Cell Edram

Kernel Approximation using Analog In-Memory Computing

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

Computing High-Degree Polynomial Gradients in Memory

An Efficient Programming Framework for Memristor-based Neuromorphic Computing

Kernel approximation using analogue in-memory computing

A Precision-Optimized Fixed-Point Near-Memory Digital Processing Unit for Analog In-Memory Computing

ALPINE: Analog In-Memory Acceleration with Tight Processor Integration for Deep Learning

Gradient Decomposition Methods for Training Neural Networks with Non-ideal Synaptic Devices

Hybrid Program Algorithm Enables Significant Reduction in Write Latency and Power Consumption for Multilevel Phase Change Memory

Optimized Programming Scheme Enabling Symmetric Conductance Modulation in HfO₂ Resistive Random-Access Memory (RRAM) for Neuromorphic Systems

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks

Multiscale Co-Design Analysis of Energy, Latency, Area, and Accuracy of a ReRAM Analog Neural Training Accelerator

Transposable 9T-SRAM Computation-In-Memory for on-Chip Learning With Probability-Based Single-Slope SAR Hybrid ADC for Edge Devices

In-memory Implementation of On-chip Trainable and Scalable ANN for AI/ML Applications

Accuracy and Resiliency of Analog Compute-in-Memory Inference Engines