Abstract:Artificial intelligence (AI) and machine learning (ML) are revolutionizing many fields of study, such as visual recognition, natural language processing, autonomous vehicles, and prediction. Traditional von-Neumann computing architecture with separated processing elements and memory devices have been improving their computing performances rapidly with the scaling of process technology. However, in the era of AI and ML, data transfer between memory devices and processing elements becomes the bottleneck of the system. To address this data movement issue, memory-centric computing takes an approach of merging the memory devices with processing elements so that computations can be done in the same location without moving any data. Processing-In-Memory (PIM) has attracted research community's attention because it can improve the energy efficiency of memory-centric computing systems substantially by minimizing the data movement. Even though the benefits of PIM are well accepted, its limitations and challenges have not been investigated thoroughly. This paper presents a comprehensive investigation of state-of-the-art PIM research works based on various memory device types, such as static-random-access-memory (SRAM), dynamic-random-access-memory (DRAM), and resistive memory (ReRAM). We will present the overview of PIM designs in each memory type, covering from bit cells, circuits, and architecture. Then, a new software stack standard and its challenges for incorporating PIM with the conventional computing architecture will be discussed. Finally, we will discuss various future research directions in PIM for further reducing the data conversion overhead, improving test accuracy, and minimizing intra-memory data movement.

An Overview of Computing-in-Memory Interfaces

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Computing In-Memory, Revisited

Memristor Based Mixed-Accuracy Computation-in-Memory System.

A Survey of Computing-in-Memory Processor: from Circuit to Application

Non-volatile Memory Based In-Memory Computing Technology

Compute-in-Memory for Numerical Computations

C 2 IM: A Compact Computing-In-Memory Unit of 10 Transistors with Standard 6T SRAM

A Review of SRAM-based Compute-in-Memory Circuits

Memristor Based Mixed-Precision Computation-in-Memory System.

A 2.75-to-75.9tops/w Computing-in-Memory NN Processor Supporting Set-Associate Block-Wise Zero Skipping and Ping-Pong CIM with Simultaneous Computation and Weight Updating.

BR-CIM: an Efficient Binary Representation Computation-In-Memory Design

In-Memory Computing: Advances and Prospects

Accuracy Optimization with the Framework of Non-Volatile Computing-In-Memory Systems

A Spatial-Designed Computing-In-Memory Architecture Based on Monolithic 3D Integration for High-Performance Systems.

An Overview of Processing-in-Memory Circuits for Artificial Intelligence and Machine Learning

In-memory computing based on phase change memory for high energy efficiency

On Designing Efficient and Reliable Nonvolatile Memory-Based Computing-In-Memory Accelerators