Abstract:Analog Compute-in-Memory (CiM) accelerators are increasingly recognized for their efficiency in accelerating Deep Neural Networks (DNN). However, their dependence on Analog-to-Digital Converters (ADCs) for accumulating partial sums from crossbars leads to substantial power and area overhead. Moreover, the high area overhead of ADCs constrains the throughput due to the limited number of ADCs that can be integrated per crossbar. An approach to mitigate this issue involves the adoption of extreme low-precision quantization (binary or ternary) for partial sums. Training based on such an approach eliminates the need for ADCs. While this strategy effectively reduces ADC costs, it introduces the challenge of managing numerous floating-point scale factors, which are trainable parameters like DNN weights. These scale factors must be multiplied with the binary or ternary outputs at the columns of the crossbar to ensure system accuracy. To that effect, we propose an algorithm-hardware co-design approach, where DNNs are first trained with quantization-aware training. Subsequently, we introduce HCiM, an ADC-Less Hybrid Analog-Digital CiM accelerator. HCiM uses analog CiM crossbars for performing Matrix-Vector Multiplication operations coupled with a digital CiM array dedicated to processing scale factors. This digital CiM array can execute both addition and subtraction operations within the memory array, thus enhancing processing speed. Additionally, it exploits the inherent sparsity in ternary quantization to achieve further energy savings. Compared to an analog CiM baseline architecture using 7 and 4-bit ADC, HCiM achieves energy reductions up to 28% and 12%, respectively

Using the IBM Analog In-Memory Hardware Acceleration Kit for Neural Network Training and Inference

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

Improving the Accuracy of Analog-Based In-Memory Computing Accelerators Post-Training

Memory Devices and A/D Interfaces: Design Tradeoffs in Mixed-Signal Accelerators for Machine Learning Applications

A Precision-Optimized Fixed-Point Near-Memory Digital Processing Unit for Analog In-Memory Computing

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

Hardware-aware training for large-scale and diverse deep learning inference workloads using in-memory computing-based accelerators

ALPINE: Analog In-Memory Acceleration with Tight Processor Integration for Deep Learning

A Heterogeneous and Programmable Compute-In-Memory Accelerator Architecture for Analog-AI Using Dense 2-D Mesh

Kernel Approximation using Analog In-Memory Computing

End-to-End DNN Inference on a Massively Parallel Analog In Memory Computing Architecture

Efficient Deployment of Transformer Models in Analog In-Memory Computing Hardware

Pipeline Gradient-based Model Training on Analog In-memory Accelerators

Hardware Accelerator Design for Sparse DNN Inference and Training: A Tutorial

Analog architectures for neural network acceleration based on non-volatile memory

Kernel approximation using analogue in-memory computing

Fast and robust analog in-memory deep neural network training

The Inherent Adversarial Robustness of Analog In-Memory Computing

HCiM: ADC-Less Hybrid Analog-Digital Compute in Memory Accelerator for Deep Learning Workloads

On the Accuracy of Analog Neural Network Inference Accelerators