Abstract:Emerging applications such as deep neural network demand high off-chip memory bandwidth. However, under stringent physical constraints of chip packages and system boards, it becomes very expensive to further increase the bandwidth of off-chip memory. Besides, transferring data across the memory hierarchy constitutes a large fraction of total energy consumption of systems, and the fraction has steadily increased with the stagnant technology scaling and poor data reuse characteristics of such emerging applications. To cost-effectively increase the bandwidth and energy efficiency, researchers began to reconsider the past processing-in-memory (PIM) architectures and advance them further, especially exploiting recent integration technologies such as 2.5D/3D stacking. Albeit the recent advances, no major memory manufacturer has developed even a proof-of-concept silicon yet, not to mention a product. This is because the past PIM architectures often require changes in host processors and/or application code which memory manufacturers cannot easily govern. In this paper, elegantly tackling the aforementioned challenges, we propose an innovative yet practical PIM architecture. To demonstrate its practicality and effectiveness at the system level, we implement it with a 20nm DRAM technology, integrate it with an unmodified commercial processor, develop the necessary software stack, and run existing applications without changing their source code. Our evaluation at the system level shows that our PIM improves the performance of memory-bound neural network kernels and applications by 11.2X and 3.5X, respectively. Atop the performance improvement, PIM also reduces the energy per bit transfer by 3.5X, and the overall energy efficiency of the system running the applications by 3.2X.

A 4.13-GHz UHS Pseudo Two-Port SRAM With BL Charge Time Reduction and Flying Word-Line for HPC Applications in 4-nm FinFET Technology

Ultrafast Self-Rectifying Memristors for Advanced In-Memory Computing

13.2 A 14nm FinFET 128Mb 6T SRAM with VMIN-enhancement techniques for low-power applications

A Dual Core Oxide 8T SRAM Cell with Low Vccmin and Dual Voltage Supplies in 45nm Triple Gate Oxide and Multi Vt CMOS for Very High Performance Yet Low Leakage Mobile SoC Applications

Radiation-Hardened 14T SRAM Bitcell with Speed and Power Optimized for Space Application

A 1-Tb, 4b/Cell, 176-Stacked-WL 3D-NAND Flash Memory with Improved Read Latency and a 14.8Gb/mm2 Density

A Charge Domain P-8T SRAM Compute-In-Memory with Low-Cost DAC/ADC Operation for 4-bit Input Processing

3D SRAM Using Ultrathin Body Nanosheets and Bitline Signal Decoupling

Bit-Interleaving-Enabled 8t Sram with Shared Data-Aware Write and Reference-Based Sense Amplifier

A Computing-in-Memory SRAM Macro Based on Fully-Capacitive-Coupling With Hierarchical Capacity Attenuator for 4-b MAC Operation

Radiation-Hardened 0.3–0.9-V Voltage-Scalable 14T SRAM and Peripheral Circuit in 28-Nm Technology for Space Applications

Radiation Hardened 12T SRAM with Crossbar-Based Peripheral Circuit in 28nm CMOS Technology

Design analysis of a low-power, high-speed 8 T SRAM cell using dual-threshold CNTFETs

A 28nm 512kb Adjacent 2T2R RRAM PUF with Interleaved Cell Mirroring and Self-Adaptive Splitting for Extremely Low Bit Error Rate of Cryptographic Key.

Hardware Architecture and Software Stack for PIM Based on Commercial DRAM Technology : Industrial Product

A Reconfigurable 4T2R ReRAM Computing In-Memory Macro for Efficient Edge Applications

A 512 Kb SRAM in 65nm CMOS with Divided Bitline and Novel Two-Stage Sensing Technique

A High-Throughput Energy–Area-Efficient Computing-in-Memory SRAM Using Unified Charge-Processing Network

A 28nm 32kb SRAM Computing-in-Memory Macro with Hierarchical Capacity Attenuator and Input Sparsity-Optimized ADC for 4b Mac Operation

A low-Power SRAM with charge cycling based read and write assist scheme

FeFET-Based Logic-in-Memory Supporting SA-Free Write-Back and Fully Dynamic Access with Reduced Bitline Charging Activity and Recycled Bitline Charge