Abstract:In-memory computing (IMC) empowers von Neumann-based computing systems to meet the performance and energy requirements of emerging data-intensive applications by offloading some computations to memory. Fortunately, many data-intensive applications that can benefit from IMC, such as image processing and neural networks, can tolerate minor accuracy loss to some extent. In this paper, we exploit this potential by using approximate computing to make a good tradeoff between performance, energy, and accuracy of data-intensive approximable applications in memory. In this regard, we present a general-purpose STT-MRAM-based digital IMC framework called Approx-IMC that, with the help of approximate computing, improves the performance and energy consumption of (multi-bit) arithmetic operations as building blocks used in data-intensive approximable applications. Approx-IMC effectively implements the given building blocks in memory in accurate and approximate fashions. To do this, first, efficient logic selection and logic synthesis are done for each building block regarding the reliability considerations of the supported in-memory logics. Next, to minimize the building blocks' execution time, the in-memory scheduling and mapping task is formulated as an integer linear programming (ILP) optimization problem. After that, the building blocks are introduced to CPU ISA as extended instructions to support the Approx-IMC blocks. Moreover, Approx-IMC memory architecture and system integration aspects have been addressed. Finally, to evaluate the framework's efficiency, the main arithmetic building blocks in most applications, including full adder, adder, and multiplier, have been implemented, and circuit-, architecture-, and application-level analyses have been conducted. The results over real-world applications reveal that by following our proposed framework, significant speedup and energy improvement can be achieved compared to CPU and a well-known in-memory computing mechanism. Furthermore, reliability evaluations show high process variation robustness and lifetime improvement.

Kernel approximation using analogue in-memory computing

Kernel Approximation using Analog In-Memory Computing

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

Approx-IMC: A general-purpose approximate digital in-memory computing framework based on STT-MRAM

IMPLY-based Approximate Full Adders for Efficient Arithmetic Operations in Image Processing and Machine Learning

Analog or Digital In-memory Computing? Benchmarking through Quantitative Modeling

Demonstration of 4-quadrant analog in-memory matrix multiplication in a single modulation

Approximate ADCs for In-Memory Computing

Benchmarking and modeling of analog and digital SRAM in-memory computing architectures

ALPINE: Analog In-Memory Acceleration with Tight Processor Integration for Deep Learning

In-Memory Computing: Advances and Prospects

Accelerating TinyML Inference on Microcontrollers through Approximate Kernels

Gradient descent-based programming of analog in-memory computing cores

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

HCiM: ADC-Less Hybrid Analog-Digital Compute in Memory Accelerator for Deep Learning Workloads

AiDAC: A Low-Cost In-Memory Computing Architecture with All-Analog Multi-Bit Compute and Interconnect

Analog architectures for neural network acceleration based on non-volatile memory

Equivalent-accuracy accelerated neural-network training using analogue memory

Efficient Image Processing via Memristive-Based Approximate In-Memory Computing

Quartet: A 22nm 0.09mj/lnference Digital Compute-in-Memory Versatile AI Accelerator with Heterogeneous Tensor Engines and Off-Chip-Less Dataflow

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks