LOW ALUMINIUM WATER, DESFERRIOXAMINE, AND DIALYSIS ENCEPHALOPATHY

F. Milne,B. Sharf,P. Bell,A. Meyers

DOI: https://doi.org/10.1016/S0140-6736(82)90535-9

IF: 202.731

1982-08-28

The Lancet

Abstract:

What problem does this paper attempt to address?

An Overview of Computing-in-Memory Interfaces

Rui Xiao,Kejie Huang,Haibin Shen

DOI: https://doi.org/10.1145/3474198.3478252

2021-01-01

Abstract:Computing-In-Memory (CIM) is one of the most promising candidates to break the “memory wall” in conventional Von Neumann computing architectures. Various CIM circuits and architectures have been proposed to achieve high computing efficiency. However, most of the designs lose sight of the computing accuracy. This paper gives an overview of the CIM interfaces, which are the most critical components in the CIM core, significantly affecting computing efficiency and accuracy. Various input interfaces, output neurons, and quantization circuits are presented. Through mathematical analysis and experimental comparison, the validity and limitation of each scheme are discussed. Finally, this paper provides the possible combinations of each component to make up the efficient and accurate CIM core.
A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

Rui Xiao,Yewei Zhang,Bo Wang,Yanfeng Xu,Jicong Fan,Haibin Shen,Kejie Huang

DOI: https://doi.org/10.1109/tvlsi.2023.3306376

2023-01-01

IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Abstract:Data transfer between the processing and storage units has become a significant bottleneck in modern von Neumann computing systems for artificial intelligence (AI) tasks. Computing in memory (CIM) has emerged as a promising candidate for lowering latency and power consumption. However, the conventional analog CIM schemes are suffering from reliability issues, which may significantly degenerate the accuracy of the computation. Recently, digitized input data and weights have been utilized for high-reliable in-memory computing. However, the properties of the digital memory and input data are not fully utilized. This article presents a novel low-power CIM scheme to further reduce the power consumption by using a modified radix-4 (M-RD4) booth algorithm at the input and a modified canonical signed digit (M-CSD) for the network weights. The simulation results show that M-RD4 and M-CSD reduce the number of nonzero activation bits by 24.2% and the number of nonzero weight bits by 36.0% in AlexNet, respectively. The power consumption can be reduced by 41.6% on average. The computing-power ratio at the fixed-point 8 bit is 60.7 tera operations per second per watt (TOPS/W), and the density is 0.177 TOPS/mm2.
Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Dayane Reis,Di Gao,Shaahin Angizi,Xunzhao Yin,Deliang Fan,Michael T. Niemier,Cheng Zhuo,Xiaobo Sharon Hu

DOI: https://doi.org/10.1145/3386263.3407580

2020-01-01

Abstract:The bottleneck between the limited memory bandwidth and high speed processing demands is the main cause of problems associated with high volume of data transfers in data-intensive applications. As a possible remedy to these issues, computing-in-memory (CiM) enables a subset of logic and arithmetic operations to be performed where the data resides, i.e., inside the memory. Various CiM designs have been proposed to date, based on different technologies. Given the variety of options available, picking the right design option for a system/application can be a complex task. When choosing a CiM design, it is important to establish evaluation conditions that are as uniform as possible to make a fair choice between available design options. In this paper, we describe a methodology for an uniform benchmarking of CiM designs. Our approach evaluates devices/circuits, arrays and the overall impact of CiM to a system with a framework based on Eva-CiM. As a case study, we analyze the array-level performance of 7 recent CiM designs implemented with SRAM, DRAM, FeFET-RAM, STT-MRAM, SOT-MRAM, and RRAM. After we identify that the FeFET-RAM-based design shows promising energy and delay savings at the array level, we carry out a system level evaluation showing that FeFET-RAM-based CiM outperforms a CMOS SRAM CiM baseline by an average of 60% across a set of 17 benchmarks (with respect to energy savings). Regarding speedups, both technologies offer virtually the same benefit of about 1.5X when compared to a situation where processing does not happen in memory.
Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

Xunzhao YIN,Jinshan YUE,Qingrong HUANG,Chao LI,Jiahao CAI,Zeyu YANG,Cheng ZHUO,Ming LIU

DOI: https://doi.org/10.1360/ssi-2021-0420

2022-01-01

Scientia Sinica Informationis

Abstract:In the era of artificial intelligence (AI) and the Internet of Things (IoT), the emerging data-driven applications and tasks have significantly promoted the development of national digitization. However, due to the separation of storage and computing in traditional von Neumann hardware, the resulted memory wall issue leads to heavy data transfer costs in data-intensive applications, which inhibits the improvements of energy efficiency and performance.As a novel computing paradigm deviating from the traditional architecture in the post-Moore era, the computing-in-memory (CiM) technique integrates computing logic into storage by leveraging the characteristics of memory devices and circuits to eliminate the data transfer overhead. Such a promising approach can significantly improve the energy efficiency and performance of intelligent hardware platforms. Based on the traditional CMOS and the emerging non-volatile memory device ferroelectric FET, this review summarizes the key CiM circuit designs, and discusses the integrated design and optimization approaches across the device, architecture, chip, algorithm, and application layers.
Memristor Based Mixed-Accuracy Computation-in-Memory System.

Ze Wang,Ruihua Yu,Bin Gao

DOI: https://doi.org/10.1109/ICICDT59917.2023.10332392

2023-01-01

Abstract:Conventional computing systems based on von Neumann computing architecture and full-accuracy digital computing paradigm are facing great challenges due to the memory-wall bottleneck issues. The compute-in-memory (CIM) technology based on emerging memristor devices can reduce data moving, and thus significantly improve the computing density and energy efficiency. However, optimizing the trade-off between computing accuracy and latency of the CIM architecture become new issues. While strides have been made in enhancing performance at the distinct levels of algorithm, system, and circuit individually, the field remains relatively uncharted when it comes to cross-level co-optimization. In this investigation, the inference accuracy of neural networks is prioritized as the chief evaluative metric, with latency considered secondary. We propose a spectrum of parameter optimization strategies for the CIM computation system, thereby offering valuable insights into the design and application of circuits.
Non-volatile Memory Based In-Memory Computing Technology

Zhou Zheng,Huang Peng,Kang Jin-Feng

DOI: https://doi.org/10.7498/aps.71.20220397

IF: 0.906

2022-01-01

Acta Physica Sinica

Abstract:By integrating the storage and computing functions on the fundamental elements, computing in-memory (CIM) technology is widely considered as a novel computational paradigm that can break the bottleneck of Von Neumann architecture. Nonvolatile memory device is an appropriate hardware implementation approach of CIM, which possess significantly advantages, such as excellent scalability, low consumption, and versatility. In this paper, first we introduce the basic concept of CIM, including the technical background and technical characteristics. Then, we review the traditional and novel nonvolatile memory devices, flash and resistive random access memory (RRAM), used in non-volatile based computing in-memory (nvCIM) system. After that, we explain the operation modes of nvCIM: in-memory analog computing and in-memory digital computing. In addition, the applications of nvCIM are also discussed, including deep learning accelerator, neuromorphic computing, and stateful logic. Finally, we summarize the current research advances in nvCIM and provide an outlook on possible research directions in the future.
CLEAR: a Full-Stack Chip-in-loop Emulator for Analog RRAM Based Computing-in-memory System

Ruihua Yu,Wenqiang Zhang,Bin Gao,Yiwen Geng,Peng Yao,Yuyi Liu,Qingtian Zhang,Jianshi Tang,Dong Wu,Hu He,Ning Deng,He Qian,Huaqiang Wu

DOI: https://doi.org/10.1007/s11432-022-3756-3

2023-01-01

Science China Information Sciences

Abstract:Deep neural networks(DNNs)have undergone tremendous advancement in several practical applications,such as ob-ject detection and text generation,over the last few years,leading to a huge demand for increased computing efficiency of hardware.Resistive random-access memory(RRAM)-based computing-in-memory(CIM)chip has been investi-gated as a promising candidate to reduce the requirement for memory bandwidth[1].CIM chips can conduct multiply-accumulate operations natively in memory units employing physical laws.Recent experimental demonstrations[2-4]and architectural designs[5]have revealed the consider-able potential of RRAM-based CIM chips in highly energy-efficient acceleration for DNNs.
An Efficient and Robust Partial Differential Equation Solver by Flash-Based Computing in Memory

Yueran Qi,Yang Feng,Jixuan Wu,Zhaohui Sun,Maoying Bai,Chengcheng Wang,Hai Wang,Xuepeng Zhan,Junyu Zhang,Jing Liu,Jiezhi Chen

DOI: https://doi.org/10.3390/mi14050901

IF: 3.4

2023-04-23

Micromachines

Abstract:Flash memory-based computing-in-memory (CIM) architectures have gained popularity due to their remarkable performance in various computation tasks of data processing, including machine learning, neuron networks, and scientific calculations. Especially in the partial differential equation (PDE) solver that has been widely utilized in scientific calculations, high accuracy, processing speed, and low power consumption are the key requirements. This work proposes a novel flash memory-based PDE solver to implement PDE with high accuracy, low power consumption, and fast iterative convergence. Moreover, considering the increasing current noise in nanoscale devices, we investigate the robustness against the noise in the proposed PDE solver. The results show that the noise tolerance limit of the solver can reach more than five times that of the conventional Jacobi CIM solver. Overall, the proposed flash memory-based PDE solver offers a promising solution for scientific calculations that require high accuracy, low power consumption, and good noise immunity, which could help to develop flash-based general computing.

chemistry, analytical,nanoscience & nanotechnology,instruments & instrumentation,physics, applied
WWW: What, When, Where to Compute-in-Memory

Tanvi Sharma,Mustafa Ali,Indranil Chakraborty,Kaushik Roy

2024-06-20

Abstract:Compute-in-memory (CiM) has emerged as a highly energy efficient solution for performing matrix multiplication during Machine Learning (ML) inference. However, integrating compute in memory poses key questions, such as 1) What type of CiM to use: Given a multitude of CiM design characteristics, determining their suitability from architecture perspective is needed. 2) When to use CiM: ML inference includes workloads with a variety of memory and compute requirements, making it difficult to identify when CiM is more beneficial. 3) Where to integrate CiM: Each memory level has different bandwidth and capacity, creating different data reuse opportunities for CiM integration. To answer such questions regarding on-chip CiM integration for accelerating ML workloads, we use an analytical architecture evaluation methodology where we tailor the dataflow mapping. The mapping algorithm aims to achieve highest weight reuse and reduced data movements for a given CiM prototype and workload. Our experiments show that CiM integrated memory improves energy efficiency by up to 3.4x and throughput by up to 15.6x compared to tensor-core-like baseline architecture, with INT-8 precision under iso-area constraints. We believe the proposed work provides insights into what type of CiM to use, and when and where to optimally integrate it in the cache hierarchy for efficient matrix multiplication.

Hardware Architecture,Distributed, Parallel, and Cluster Computing,Machine Learning
A 2.75-to-75.9tops/w Computing-in-Memory NN Processor Supporting Set-Associate Block-Wise Zero Skipping and Ping-Pong CIM with Simultaneous Computation and Weight Updating.

Jinshan Yue,Xiaoyu Feng,Yifan He,Yuxuan Huang,Yipeng Wang,Zhe Yuan,Mingtao Zhan,Jiaxin Liu,Jian-Wei Su,Yen-Lin Chung,Ping-Chun Wu,Li-Yang Hung,Meng-Fan Chang,Nan Sun,Xueqing Li,Huazhong Yang,Yongpan Liu

DOI: https://doi.org/10.1109/isscc42613.2021.9365958

2021-01-01

Abstract:Computing-in-memory (CIM) is an attractive approach for energy-efficient neural network (NN) processors, especially for low-power edge devices. Previous CIM chips [1] –[5] have demonstrated macro and system-level design enabling multi-bit operations and sparsity support. However, several challenges exist, as shown in Fig. 15.2.1. First, though a previously proposed block-wise sparsity strategy [5] can power off ADCs, zeros still contributed to storage requirements, and power gating was not applied to computing resources. Second, on-chip SRAM CIM macros are not large enough to hold all weights. Updating weights between computing operations leads to significant performance loss. Finally, the limited sensing margin incurs poor accuracy for large NN models on practical datasets, such as ImageNet. The precision and power of the ADCs should be optimized and adjusted.
In-Memory Computing: Advances and Prospects

Naveen Verma,Hongyang Jia,Hossein Valavi,Yinqi Tang,Murat Ozatay,Lung-Yen Chen,Bonan Zhang,Peter Deaville

DOI: https://doi.org/10.1109/mssc.2019.2922889

2019-01-01

Abstract:High-dimensionality matrix-vector multiplication (MVM) is a dominant kernel in signal-processing and machine-learning computations that are being deployed in a range of energy- and throughput-constrained applications. In-memory computing (IMC) exploits the structural alignment between a dense 2D array of bit cells and the dataflow in MVM, enabling opportunities to address computational energy and throughput. Recent prototypes have demonstrated the potential for 10 × benefits in both metrics. However, fitting computation within an array of constrained bit-cell circuits imposes a number of challenges, including the need for analog computation, efficient interfacing with conventional digital accelerators (enabling the required programmability), and efficient virtualization of the hardware to map software. This article provides an overview of the fundamentals of IMC to better explain these challenges and then identifies promising paths forward among the wide range of emerging research.

English Else
In-Memory Computing: The Next-Generation AI Computing Paradigm

Yufei Ma,Yuan Du,Li Du,Jun Lin,Zhongfeng Wang

DOI: https://doi.org/10.1145/3386263.3407588

2020-01-01

Abstract:To overcome the memory bottleneck of von-Neuman architecture, various memory-centric computing techniques are emerging to reduce the latency and energy consumption caused by data communication. The great success of artificial intelligence (AI) algorithms, which involve a large number of computations and data movements, has motivated and accelerated the recent researches of in-memory computing (IMC) techniques to significantly reduce or even diminish the accesses of off-chip data, where memory is not only storing data but can also directly output computation results. For example, the multiply-and-accumulate (MAC) operations in deep learning algorithms can be realized by accessing the memory using the input activations. This paper will investigate the recent trends of IMC from techniques (SRAM, flash, RRAM and other types of non-volatile memory) to architecture and to applications, which will serve as a guide to the future advances on computing in-memory (CIM).
Computing In-Memory, Revisited

Dejan Milojicic,Kirk Bresniker,Gary Campbell,Paolo Faraboschi,John Paul Strachan,Stan Williams

DOI: https://doi.org/10.1109/icdcs.2018.00130

2018-07-01

Abstract:The Von Neumann's architecture has been the dominant computing paradigm ever since its inception in the mid-forties. It revolves around the concept of a “stored program” in memory, and a central processing unit that executes the program. As an alternative, Processing-In-Memory (PIM) ideas have been around for at least two decades, however with very limited adoption. Today, three trends are creating a compelling motivation to take a second look. Novel devices such as memristor blur the boundary between memory and compute, effectively providing both in the same element. Power efficiency has become very important, both in the datacenter and at the edge. Machine learning applications driven by a data-flow model have become ubiquitous. In this paper, we sketch our Computing-In-Memory (CIM) vision, and its substantial performance and power improvement potential. Compared to PIM models, CIM more clearly separates computing from memory. We then discuss the programming model, which we consider the biggest challenge. We close by describing how CIM impacts non-functional characteristics, such as reliability, scale, and configurability.
34.3 A 22nm 64kb Lightning-Like Hybrid Computing-in-Memory Macro with a Compressed Adder Tree and Analog-Storage Quantizers for Transformer and CNNs.

An Guo,Xi Chen,Fangyuan Dong,Jinwu Chen,Zhihang Yuan,Xing Hu,Yuanpeng Zhang,Jingmin Zhang,Yuchen Tang,Zhican Zhang,Gang Chen,Dawei Yang,Zhaoyang Zhang,Lizheng Ren,Tianzhu Xiong,Bo Wang,Bo Liu,Weiwei Shan,Xinning Liu,Hao Cai,Guangyu Sun,Jun Yang,Xin Si

DOI: https://doi.org/10.1109/ISSCC49657.2024.10454278

2024-01-01

Abstract:SRAM-based computing-in-memory (CIM) has made significant progress in improving the energy efficiency (EF) of neural operators, specifically MAC, used in AI applications. Prior CIM methods have demonstrated attractive energy efficiencies (EF) under a fixed/less of accumulation length, sparsity, toggle rate, and bit precision [1] –[6]. Analog CIMs (ACIM) offer potentially higher EF but are susceptible to PVT variations. On the other hand, digital CIMs (DCIM) are robust but provide moderate energy efficiency. In prior weight-wise-cut structures [1], when processing INT8 MUL operations, a calculation error occurred as the low-place-value weight directly influences the results, which leads to accuracy loss. In prior vertical-cut structures [2], more digital components are used to ensure inference accuracy; however, 64 local-computing cells are required for each bank, which results in a large area overhead and power consumption. As depicted in Fig. 34.3.1, challenges arise when applying these approaches to higher bitprecision MAC operations: (1) in balancing tradeoffs between inference accuracy and the area/energy overhead of hybrid analog-digital CIM; (2) the significant energy consumption and error accumulation of the readout circuit in ACIM; and (3) the limited EF and DCIM performance due to the large-scale adder tree.
Compute-in-Memory Technologies and Architectures for Deep Learning Workloads

Mustafa Ali,Sourjya Roy,Utkarsh Saxena,Tanvi Sharma,Anand Raghunathan,Kaushik Roy

DOI: https://doi.org/10.1109/tvlsi.2022.3203583

2022-10-23

IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Abstract:The use of deep learning (DL) to real-world applications, such as computer vision, speech recognition, and robotics, has become ubiquitous. This can be largely attributed to a virtuous cycle between algorithms, data and computing, and storage capacity, which has driven rapid advances in all these dimensions. The ever-increasing demand for computation and memory from DL workloads presents challenges across the entire spectrum of computing platforms, from edge devices to the cloud. Hence, there is a need to explore new hardware paradigms that go well beyond the current mainstays such as graphical processing units (GPUs), tensor processing units (TPUs), and neural processing units (NPUs). A key bottleneck of current platforms is the so-called memory wall, which arises from the need to move large amounts of data between memory and compute units, expending considerable time and energy. One promising solution to this challenge is to move some computations either closer to memory, within the memory subsystem, or even within individual memory arrays. This approach, which is broadly referred to as compute-in-memory (CiM), has the potential to break the memory wall, and thereby greatly improve speed and power consumption. In this article, we provide an overview of CiM techniques used at different levels of the memory hierarchy and based on different memory technologies, including static random access memories (SRAMs), nonvolatile memories (NVMs), and DRAMs. We also discuss architectural approaches to designing CiM-based DL accelerators. Finally, we discuss the challenges associated with adopting CiM in future DL accelerators.

engineering, electrical & electronic,computer science, hardware & architecture
BR-CIM: an Efficient Binary Representation Computation-In-Memory Design

Zhiheng Yue,Yabing Wang,Yubin Qin,Leibo Liu,Shaojun Wei,Shouyi Yin

DOI: https://doi.org/10.1109/tcsi.2022.3185135

2022-01-01

IEEE Transactions on Circuits and Systems I Regular Papers

Abstract:Deep neural network (DNN) has recently attracted tremendous attention in various fields. But the computing operation requirement and the memory bottleneck limit the energy efficiency of hardware implementations. Binary quantization is proposed to relieve the pressure of hardware design. And the Computing-In-Memory (CIM) is regarded as a promising method to resolve the memory wall challenge. However, the binary computing paradigm is mismatched with the CIM scheme, which incurs complex circuits and peripheral to realize binary operation in previous works. To overcome previous issues, this work presents Binary Representation Computation-In-Memory (BR-CIM) with several key features. (1) A lightweight computation unit is realized within the 6T SRAM array to accelerate binary computing and enlarge signal margin; (2) The reconfigurable computing scheme and mapping method support extendable bit precision to satisfy the accuracy requirement of various applications; (3) Simultaneous computing and weight loading is supported by column circuitry, which shortens the data loading latency; Several experiments are conducted to estimate algorithm accuracy, the computing latency, and power consumption. The energy efficiency reaches up to 1280 TOPs/W for binary representation. And the algorithm accuracy achieves 97.82%/76.4% on MNIST/CIFAR-100 dataset.
An Energy-Efficient Floating-Point Compute SRAM with Pipelined In-Memory Bit-Parallel Exponent and Bitwise Mantissa Processing

Yangzhan Mai,Mingyu Wang,Baiqing Zhong,Chuanghao Zhang,Yicong Zhang,Zhiyi Yu

DOI: https://doi.org/10.1049/ell2.12885

2023-01-01

Electronics Letters

Abstract:The promise of compute-in-memory (CIM) for energy-efficient deep neural network (DNN) tasks has been demonstrated. However, most previous CIM works typically focus on low-precision DNN computing. To enable high-precision DNN computing, this work presents a novel SRAM-CIM design that fully supports half-precision floating-point (FP16) MAC operations. To maximize the energy efficiency, an efficient in-memory bit-parallel approach for conducting exponent operations and the bitwise in-memory booth encoder for reducing mantissa multiplication latency are proposed. Moreover, by enabling the pipeline of exponent and mantissa processing, the hardware utilization is improved with high throughput achieved. The proposed design is analyzed in 40 nm CMOS technology. The evaluation shows that the SRAM-CIM achieves a frequency of 714 MHz and a peak energy efficiency of 1.53 TFLOPS/W.
A compute-in-memory chip based on resistive random-access memory

Weier Wan,Rajkumar Kubendran,Clemens Schaefer,Sukru Burc Eryilmaz,Wenqiang Zhang,Dabin Wu,Stephen Deiss,Priyanka Raina,He Qian,Bin Gao,Siddharth Joshi,Huaqiang Wu,H.-S. Philip Wong,Gert Cauwenberghs

DOI: https://doi.org/10.1038/s41586-022-04992-8

IF: 17.694

2022-08-18

NanoScience and Technology

Abstract:Realizing increasingly complex artificial intelligence (AI) functionalities directly on edge devices calls for unprecedented energy efficiency of edge hardware. Compute-in-memory (CIM) based on resistive random-access memory (RRAM) 1 promises to meet such demand by storing AI model weights in dense, analogue and non-volatile RRAM devices, and by performing AI computation directly within RRAM, thus eliminating power-hungry data movement between separate compute and memory 2,3,4,5 . Although recent studies have demonstrated in-memory matrix-vector multiplication on fully integrated RRAM-CIM hardware 6,7,8,9,10,11,12,13,14,15,16,17 , it remains a goal for a RRAM-CIM chip to simultaneously deliver high energy efficiency, versatility to support diverse models and software-comparable accuracy. Although efficiency, versatility and accuracy are all indispensable for broad adoption of the technology, the inter-related trade-offs among them cannot be addressed by isolated improvements on any single abstraction level of the design. Here, by co-optimizing across all hierarchies of the design from algorithms and architecture to circuits and devices, we present NeuRRAM—a RRAM-based CIM chip that simultaneously delivers versatility in reconfiguring CIM cores for diverse model architectures, energy efficiency that is two-times better than previous state-of-the-art RRAM-CIM chips across various computational bit-precisions, and inference accuracy comparable to software models quantized to four-bit weights across various AI tasks, including accuracy of 99.0 percent on MNIST 18 and 85.7 percent on CIFAR-10 19 image classification, 84.7-percent accuracy on Google speech command recognition 20 , and a 70-percent reduction in image-reconstruction error on a Bayesian image-recovery task.
Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

Yuyi Liu,Bin Gao,Jianshi Tang,Huaqiang Wu,He Qian

DOI: https://doi.org/10.1007/s11432-023-3785-8

2023-01-01

Abstract:Computation-in-memory (CIM) chips offer an energy-efficient approach to artificial intelligence computing workloads. Resistive random-access memory (RRAM)-based CIM chips have proven to be a promising solution for overcoming the von Neumann bottleneck. In this paper, we review our recent studies on the architecture-circuit-technology co-optimization of scalable CIM chips and related hardware demonstrations. To further minimize data movements between memory and computing units, architecture optimization methods have been introduced. Then, we propose a device-architecture-algorithm co-design simulator to provide guidelines for designing CIM systems. A physics-based compact RRAM model and an array-level analog computing model were embedded in the simulator. In addition, a CIM compiler was proposed to optimize the on-chip dataflow. Finally, research perspectives are proposed for future development.
A Survey of Computing-in-Memory Processor: from Circuit to Application

Wenyu Sun,Jinshan Yue,Yifan He,Zongle Huang,Jingyu Wang,Wenbin Jia,Yaolei Li,Luchang Lei,Hongyang Jia,Yongpan Liu

DOI: https://doi.org/10.1109/ojsscs.2023.3328290

2023-01-01

IEEE Open Journal of the Solid-State Circuits Society

Abstract:The computing-in-memory (CIM) technique is emerging with the evolvement of big data and artificial intelligence (AI) application. The manuscript presents a systematic review of existing CIM works in a bottom-up view from circuit to application. Various types of CIM circuits based on different volatile/non-volatile devices are introduced. The micro CIM architectures are illustrated to support multi-bit precision computation. After that, several types of processor-level CIM chips are analyzed to reveal the system architecture design considerations. The corresponding CIM tool chains and applications beyond AI applications are also introduced. From circuit to application levels, this manuscript analyzes the design trade-offs, remained challenges and possible future design trends at different design hierarchies of CIM processors.

LOW ALUMINIUM WATER, DESFERRIOXAMINE, AND DIALYSIS ENCEPHALOPATHY

An Overview of Computing-in-Memory Interfaces

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

Memristor Based Mixed-Accuracy Computation-in-Memory System.

Non-volatile Memory Based In-Memory Computing Technology

CLEAR: a Full-Stack Chip-in-loop Emulator for Analog RRAM Based Computing-in-memory System

An Efficient and Robust Partial Differential Equation Solver by Flash-Based Computing in Memory

WWW: What, When, Where to Compute-in-Memory

A 2.75-to-75.9tops/w Computing-in-Memory NN Processor Supporting Set-Associate Block-Wise Zero Skipping and Ping-Pong CIM with Simultaneous Computation and Weight Updating.

In-Memory Computing: Advances and Prospects

In-Memory Computing: The Next-Generation AI Computing Paradigm

Computing In-Memory, Revisited

34.3 A 22nm 64kb Lightning-Like Hybrid Computing-in-Memory Macro with a Compressed Adder Tree and Analog-Storage Quantizers for Transformer and CNNs.

Compute-in-Memory Technologies and Architectures for Deep Learning Workloads

BR-CIM: an Efficient Binary Representation Computation-In-Memory Design

An Energy-Efficient Floating-Point Compute SRAM with Pipelined In-Memory Bit-Parallel Exponent and Bitwise Mantissa Processing

A compute-in-memory chip based on resistive random-access memory

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

A Survey of Computing-in-Memory Processor: from Circuit to Application