Abstract:In the post-Moore's era, compute-in-memory (CIM) techniques are promising to break the memory wall. In particular, SRAM-based CIMs (SRAM-CIMs) have attracted widespread attention owing to its good scalability with advanced process. At present, a rich variety of works focus on energy-efficiency improvement by either designing different bit-cell structures or optimizing circuit/chip architectures. However, owing to the CIM's primitive property to store one of the operands in the memory bit-cells, substantial computing resource is wasted by suspension during the operands loading procedure. In this paper, a high-throughput SRAM-CIM (HiT-CIM) architecture with simultaneous weight loading and computing capabilities is proposed by integrating on-chip nonvolatile MRAM (magnetic random-access memory). Meanwhile, both the mainstream current-domain and charge-domain SRAM bit-cell structures are optimized to support such an architecture. Furthermore, a reconfigurable fully-pipelined MRAM is designed to provide fast data loading in HiT-CIM, which can finetune weight loading strategy rapidly for different neural network models. Afterwards, an optimal evaluation and configuration strategy is proposed to improve the macro-level performance by considering the key components and parameters in terms of SRAM array, ADC, MRAM structure and frequency. Finally, the HiT-CIM's feasibility is verified under a 40-nm foundry's process. The results show that a multiple-fold speed improvement can be obtained on VGG19, ResNet18 and MobileNetV1, respectively. In specific, the area efficiency of HiT-CIM on VGG19 achieves 1124 GOPS/mm2 and 1880.12 GOPS/mm2 for the current-domain and chargedomain SRAM-CIMs, respectively. Up to 5.3× improvement is realized compared with prior works

Research on Progress of Computing In-Memory Based on Static Random-Access Memory

An Overview of Computing-in-Memory Interfaces

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

A review on SRAM-based computing in-memory: Circuits, functions, and applications

In Situ Storing 8T SRAM-CIM Macro for Full-Array Boolean Logic and Copy Operations

Computing-in-Memory Architecture based on Field-Free SOT-MRAM with Self-Reference Method

Non-volatile Memory Based In-Memory Computing Technology

A 9T-SRAM Based Computing-in-memory with Redundant Unit and Digital Operation for Boolean Logic and MAC

HiT-CIM: A High-Throughput Compute-In-Memory SRAM Architecture with Simultaneous Weight Loading/Computing and Balance Capabilities

Trends and challenges in the circuit and macro of RRAM-based computing-in-memory systems

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

Static Random‐access Memory with Embedded Arithmetic Logic Units for In‐memory Computing and Ternary Content Addressable Memory Operation

Challenges and Trends of SRAM-Based Computing-In-Memory for AI Edge Devices

Configurable Memory with a Multilevel Shared Structure Enabling In-Memory Computing

Computing-in-Memory Paradigm Based on STT-MRAM with Synergetic Read/Write-Like Modes

A Survey of MRAM-Centric Computing: from Near Memory to in Memory

SRAM-based Compute-in-memory: Status and Challenges

Computing In-Memory, Revisited

In-Memory Computing: The Next-Generation AI Computing Paradigm

Design of an Area-Efficient Computing in Memory Platform Based on STT-MRAM