A Review of SRAM-based Compute-in-Memory Circuits

Kentaro Yoshioka,Shimpei Ando,Satomi Miyagi,Yung-Chin Chen,Wenlun Zhang
2024-11-09
Abstract:This paper presents a tutorial and review of SRAM-based Compute-in-Memory (CIM) circuits, with a focus on both Digital CIM (DCIM) and Analog CIM (ACIM) implementations. We explore the fundamental concepts, architectures, and operational principles of CIM technology. The review compares DCIM and ACIM approaches, examining their respective advantages and challenges. DCIM offers high computational precision and process scaling benefits, while ACIM provides superior power and area efficiency, particularly for medium-precision applications. We analyze various ACIM implementations, including current-based, time-based, and charge-based approaches, with a detailed look at charge-based ACIMs. The paper also discusses emerging hybrid CIM architectures that combine DCIM and ACIM to leverage the strengths of both approaches.
Hardware Architecture
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the bottlenecks encountered by current computing architectures when handling artificial intelligence and machine - learning workloads such as deep neural networks (DNN). Specifically, due to the physical separation of the processor and memory in the traditional von Neumann architecture, the "memory wall" problem is encountered during data transmission, which limits performance and power - consumption efficiency. Moreover, although GPU is the de - facto standard for DNN computing hardware at present, higher requirements for the power - consumption efficiency of AI/ML processing are put forward in various scenarios from edge devices to data centers. To solve these problems, researchers are exploring new computing paradigms, especially SRAM - based Compute - In - Memory (CIM) technology. CIM aims to minimize data movement and significantly enhance parallel processing ability and power - consumption efficiency by physically integrating memory and computing units. ### Main content of the paper The paper mainly reviews and analyzes SRAM - based digital Compute - In - Memory (DCIM) and analog Compute - In - Memory (ACIM) circuits, as well as their respective advantages and disadvantages. Specific contents include: 1. **Basic concepts and architectures**: Introduces the basic principles, architectures, and operation mechanisms of CIM, with special emphasis on the importance of dot - product operations. 2. **Digital Compute - In - Memory (DCIM)**: Discusses in detail the characteristics, advantages, and challenges of DCIM, including high - precision computing and design flexibility, but also has problems of low area and power - consumption efficiency. 3. **Analog Compute - In - Memory (ACIM)**: Analyzes in - depth different implementation methods of ACIM (such as current - based, time - based, and charge - based methods) and explores its superior power and area efficiency in medium - precision applications. 4. **Hybrid CIM architectures**: Discusses hybrid architectures that combine the advantages of DCIM and ACIM to fully utilize their respective strengths. 5. **Future directions**: Summarizes the key challenges, opportunities, and potential future development directions of CIM technology. ### Formula examples The formulas involved in the paper are mainly used to describe the operation process of CIM. For example, the dot - product operation can be expressed as: \[ y = \sum_{i = 1}^{n} IN_{i}\cdot W_{i} \] where \(IN_{i}\) and \(W_{i}\) are the \(i\)-th elements of the input vector and the weight vector respectively, and \(n\) is the vector length. For multi - bit representation, the input vector and the weight vector can be expressed as: \[ IN_{i}=\sum_{j = 0}^{m - 1} IN_{i,j}\cdot2^{j}, \quad W_{i}=\sum_{k = 0}^{p - 1} W_{i,k}\cdot2^{k} \] The multi - bit dot - product operation then becomes: \[ y=\sum_{j = 0}^{m - 1}\sum_{k = 0}^{p - 1}\left(\sum_{i = 1}^{n} IN_{i,j}\cdot W_{i,k}\right)\cdot2^{j + k} \] These formulas show the core logic of CIM in performing dot - product operations, ensuring efficient data - processing capabilities. ### Summary Through a comprehensive review and analysis of SRAM - based CIM circuits, this paper aims to provide a profound understanding of this cutting - edge technology and point out the direction for future CIM research and development.