Abstract:Big data processing has exposed the limits of compute-centric hardware acceleration due to the memory-to-processor bandwidth bottleneck. Consequently, there has been a shift towards memory-centric architectures, leveraging substantial compute parallelism by processing using the memory elements directly. Computing-in-memory (CIM) proposals for both conventional and emerging memory technologies often target massively parallel operations. However, current CIM solutions face significant challenges. For emerging data-intensive applications, such as advanced machine learning techniques and bioinformatics, where matrix multiplication is a key primitive, memristor crossbars suffer from limited write endurance and expensive write operations. In contrast, while DRAM-based solutions have successfully demonstrated multiplication using additions, they remain prohibitively slow. This paper introduces Count2Multiply, a technology-agnostic digital-CIM method for performing integer-binary and integer-integer matrix multiplications using high-radix, massively parallel counting implemented with bitwise logic operations. In addition, Count2Multiply is designed with fault tolerance in mind and leverages traditional scalable row-wise error correction codes, such as Hamming and BCH codes, to protect against the high error rates of existing CIM designs. We demonstrate Count2Multiply with a detailed application to CIM in conventional DRAM due to its ubiquity and high endurance. We also explore the acceleration potential of racetrack memories due to their shifting properties, which are natural for Count2Multiply, and their high endurance. Compared to the state-of-the-art in-DRAM method, Count2Multiply achieves up to 10x speedup, 3.8x higher GOPS/Watt, and 1.4x higher GOPS/area, while the RTM counterpart offers gains of 10x, 57x, and 3.8x.

Novel In-Memory Matrix-Matrix Multiplication with Resistive Cross-Point Arrays

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

In-Memory Multi-Bit Multiplication and Accumulation (MAC) Using FeFET for Energy Efficient IoT

An Energy-Efficient Matrix Multiplication Accelerator by Distributed In-Memory Computing on Binary RRAM Crossbar.

Proposal of Analog In-Memory Computing with Magnified Tunnel Magnetoresistance Ratio and Universal STT-MRAM Cell

AiDAC: A Low-Cost In-Memory Computing Architecture with All-Analog Multi-Bit Compute and Interconnect

Fault-Tolerant Masked Matrix Accumulation using Bulk Bitwise In-Memory Engines

Demonstration of 4-quadrant analog in-memory matrix multiplication in a single modulation

Modeling and Mitigating the Interconnect Resistance Issue in Analog RRAM Matrix Computing Circuits

Multiply Accumulate Operations in Memristor Crossbar Arrays for Analog Computing

In-memory sparse matrix multiplication with a low-power self-rectifying memristor array

Tutorial: Analog Matrix Computing (AMC) with Crosspoint Resistive Memory Arrays

Large Memristor Crossbars for Analog Computing

BlockAMC: Scalable In-Memory Analog Matrix Computing for Solving Linear Systems

A Memristor Crossbar Based Computing Engine Optimized for High Speed and Accuracy

In-Memory Computing: Advances and Prospects

A Novel Cross-Point Mram with Diode Selector Capable of High-Density, High-Speed, and Low-Power In-Memory Computation

Area-Aware Optimization of MRAM Crossbar Array Bit-Cell for In-Memory Computing

Novel Hybrid Computing Architecture With Memristor-Based Processing-In-Memory For Data-Intensive Applications

Technological Exploration of Rram Crossbar Array for Matrix-Vector Multiplication

Resistive Memory‐Based In‐Memory Computing: From Device and Large‐Scale Integration System Perspectives