Abstract:Big data processing has exposed the limits of compute-centric hardware acceleration due to the memory-to-processor bandwidth bottleneck. Consequently, there has been a shift towards memory-centric architectures, leveraging substantial compute parallelism by processing using the memory elements directly. Computing-in-memory (CIM) proposals for both conventional and emerging memory technologies often target massively parallel operations. However, current CIM solutions face significant challenges. For emerging data-intensive applications, such as advanced machine learning techniques and bioinformatics, where matrix multiplication is a key primitive, memristor crossbars suffer from limited write endurance and expensive write operations. In contrast, while DRAM-based solutions have successfully demonstrated multiplication using additions, they remain prohibitively slow. This paper introduces Count2Multiply, a technology-agnostic digital-CIM method for performing integer-binary and integer-integer matrix multiplications using high-radix, massively parallel counting implemented with bitwise logic operations. In addition, Count2Multiply is designed with fault tolerance in mind and leverages traditional scalable row-wise error correction codes, such as Hamming and BCH codes, to protect against the high error rates of existing CIM designs. We demonstrate Count2Multiply with a detailed application to CIM in conventional DRAM due to its ubiquity and high endurance. We also explore the acceleration potential of racetrack memories due to their shifting properties, which are natural for Count2Multiply, and their high endurance. Compared to the state-of-the-art in-DRAM method, Count2Multiply achieves up to 10x speedup, 3.8x higher GOPS/Watt, and 1.4x higher GOPS/area, while the RTM counterpart offers gains of 10x, 57x, and 3.8x.

Fault-Tolerant Masked Matrix Accumulation using Bulk Bitwise In-Memory Engines

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

An Energy-Efficient Matrix Multiplication Accelerator by Distributed In-Memory Computing on Binary RRAM Crossbar.

MatPIM: Accelerating Matrix Operations with Memristive Stateful Logic

An 8.8 TFLOPS/W Floating-Point RRAM-Based Compute-in-Memory Macro Using Low Latency Triangle-Style Mantissa Multiplication

Coordinated DMA: Improving the DRAM Access Efficiency for Matrix Multiplication.

IMAC: In-Memory Multi-Bit Multiplication and ACcumulation in 6T SRAM Array

Novel In-Memory Matrix-Matrix Multiplication with Resistive Cross-Point Arrays

Reliability aspects of binary vector-matrix-multiplications using ReRAM devices

A Computing-in-memory Scheme with Series Bit-cell in STT-MRAM for Efficient Multi-bit Analog Multiplication

A Computing In-Memory Multibit Multiplication Based on Decoupling and In-Array Storing

Improving the DRAM Access Efficiency for Matrix Multiplication on Multicore Accelerators.

A 40nm 150 TOPS/W High Row-Parallel MRAM Compute-in-Memory Macro with Series 3T1MTJ Bitcell for MAC Operation

A Low Power In-Memory Multiplication andAccumulation Array with Modified Radix-4 Inputand Canonical Signed Digit Weights

In-Memory Computing: Advances and Prospects

Towards Error Correction for Computing in Racetrack Memory

A CFMB STT-MRAM-Based Computing-in-Memory Proposal with Cascade Computing Unit for Edge AI Devices

Multiply Accumulate Operations in Memristor Crossbar Arrays for Analog Computing

In-memory Multiplication Engine with SOT-MRAM Based Stochastic Computing

Probabilistic Compute-in-Memory Design For Efficient Markov Chain Monte Carlo Sampling

An RRAM-Based Digital Computing-in-Memory Macro with Dynamic Voltage Sense Amplifier and Sparse-Aware Approximate Adder Tree