Abstract:In-memory computing (IMC) empowers von Neumann-based computing systems to meet the performance and energy requirements of emerging data-intensive applications by offloading some computations to memory. Fortunately, many data-intensive applications that can benefit from IMC, such as image processing and neural networks, can tolerate minor accuracy loss to some extent. In this paper, we exploit this potential by using approximate computing to make a good tradeoff between performance, energy, and accuracy of data-intensive approximable applications in memory. In this regard, we present a general-purpose STT-MRAM-based digital IMC framework called Approx-IMC that, with the help of approximate computing, improves the performance and energy consumption of (multi-bit) arithmetic operations as building blocks used in data-intensive approximable applications. Approx-IMC effectively implements the given building blocks in memory in accurate and approximate fashions. To do this, first, efficient logic selection and logic synthesis are done for each building block regarding the reliability considerations of the supported in-memory logics. Next, to minimize the building blocks' execution time, the in-memory scheduling and mapping task is formulated as an integer linear programming (ILP) optimization problem. After that, the building blocks are introduced to CPU ISA as extended instructions to support the Approx-IMC blocks. Moreover, Approx-IMC memory architecture and system integration aspects have been addressed. Finally, to evaluate the framework's efficiency, the main arithmetic building blocks in most applications, including full adder, adder, and multiplier, have been implemented, and circuit-, architecture-, and application-level analyses have been conducted. The results over real-world applications reveal that by following our proposed framework, significant speedup and energy improvement can be achieved compared to CPU and a well-known in-memory computing mechanism. Furthermore, reliability evaluations show high process variation robustness and lifetime improvement.

LLM-Powered Approximate Intermittent Computing

Approxify: Automating Energy-Accuracy Trade-offs in Batteryless IoT Devices

LMM: A Fixed-Point Linear Mapping Based Approximate Multiplier for IoT

Optimally Approximated and Unbiased Floating-Point Multiplier with Runtime Configurability

An Efficient and Flexible Learning Framework for Dynamic Power and Thermal Co-Management

PAM: A Piecewise-Linearly-Approximated Floating-Point Multiplier with Unbiasedness and Configurability

Approximate Computing for Low Power and Security in the Internet of Things

Intermittent Learning: On-Device Machine Learning on Intermittently Powered System

Memory-Aware Partitioning of Machine Learning Applications for Optimal Energy Use in Batteryless Systems

Optimal Checkpointing for Secure Intermittently-Powered IoT Devices

Exploiting Significance of Computations for Energy-Constrained Approximate Computing

RMLIM: A Runtime Machine Learning Based Identification Model for Approximate Computing on Data Flow Graphs

Designing of Energy-Efficient Approximate Multiplier Circuit for Processing Unit of IoT Devices

Energy-Latency Computation Offloading and Approximate Computing in Mobile-Edge Computing Networks

Approx-IMC: A general-purpose approximate digital in-memory computing framework based on STT-MRAM

Incidental Computing on IoT Nonvolatile Processors

ADEPOS: A Novel Approximate Computing Framework for Anomaly Detection Systems and its Implementation in 65nm CMOS

A Study on Approximate Computing for Non-volatile Memory-Based Memory Systems

IAA: Incidental Approximate Architectures for Extremely Energy-Constrained Energy Harvesting Scenarios Using IoT Nonvolatile Processors.

Analyzing the Energy and Accuracy of LLMs in Software Development

QoS-Adaptive Approximate Real-Time Computation for Mobility-Aware IoT Lifetime Optimization