Abstract:Convolutional neural networks (CNNs) have achieved significant success in various applications. Numerous hardware accelerators are introduced to accelerate CNN execution with improved energy efficiency compared to traditional software implementations. Despite the achieved success, deploying traditional hardware accelerators for bulky CNNs on current and emerging smart devices is impeded by limited resources, including memory, power, area, and computational capabilities. Recent works introduced processing-in-memory (PIM), a non-Von-Neumann architecture, which is a promising approach to tackle the problem of data movement between logic and memory blocks. However, as observed from the literature, the existing PIM architectures cannot congregate all the computational operations due to limited programmability and flexibility. Furthermore, the capabilities of the PIM are challenged by the limited available on-chip memory. To enable faster computations and address the limited on-chip memory constraints, this work introduces a novel reconfigurable approximate computing-based PIM, termed ReApprox-PIM. The proposed ReApprox-PIM is capable of addressing the two challenges mentioned above in the following manner: (i) it utilizes a programmable look-up-table (LUT)-based processing architecture that can support different approximate computing techniques via programmability, and (ii) followed by resource-efficient, fast CNN computing via the implementation of highly-optimized approximate computing techniques. This results in improved computing footprint, operational parallelism, and reduced computational latency and power consumption compared to prior PIMs relying on exact computations for CNN inference acceleration at a minimal sacrifice of accuracy. We have evaluated the proposed ReApprox-PIM on various CNN architectures, for inference applications including standard LeNet, AlexNet, ResNet-18, -34, and -50. Our experimental results show that the ReApprox-PIM achieves a speedup of 1.63× with 1.66 × lower area for the processing components compared to the existing PIM architectures. Furthermore, the proposed ReApprox-PIM achieves 2.5× higher energy efficiency and 1.3× higher throughput compared to the state-of-the-art LUT-based PIM architectures.

CMP-PIM: An Energy-Efficient Comparator-based Processing-In-Memory Neural Network Accelerator

A design framework for processing-in-memory accelerator

Functionality-Based Processing-in-Memory Accelerator for Deep Convolutional Neural Networks

ConvPIM: Evaluating Digital Processing-in-Memory through Convolutional Neural Network Acceleration

Parapim: A Parallel Processing-In-Memory Accelerator For Binary-Weight Deep Neural Networks

Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of Peripherals

IMCE: Energy-efficient Bit-Wise In-Memory Convolution Engine for Deep Neural Network

pPIM: A Programmable Processor-in-Memory Architecture With Precision-Scaling for Deep Learning

ReHy: A ReRAM-based Digital/Analog Hybrid PIM Architecture for Accelerating CNN Training

ReApprox-PIM: Reconfigurable Approximate Look-Up-Table (LUT)-Based Processing-in-Memory (PIM) Machine Learning Accelerator

PIMCOMP: An End-to-End DNN Compiler for Processing-In-Memory Accelerators

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

APIM: An Antiferromagnetic MRAM-Based Processing-In-Memory System for Efficient Bit-level Operations of Quantized Convolutional Neural Networks

DIMA: A Depthwise CNN In-Memory Accelerator

An Efficient Racetrack Memory-Based Processing-in-Memory Architecture for Convolutional Neural Networks

PIMSAB: A Processing-In-Memory System with Spatially-Aware Communication and Bit-Serial-Aware Computation

NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing

VSPIM: SRAM Processing-in-Memory DNN Acceleration via Vector-Scalar Operations

An Energy-Efficient Quantized and Regularized Training Framework for Processing-In-Memory Accelerators

NAND-SPIN-based processing-in-MRAM architecture for convolutional neural network acceleration

PIMulator-NN: an Event-Driven, Cross-level Simulation Framework for Processing-In-Memory Based Neural Network Accelerators