Abstract:This article presents a communication-aware processing-in-memory deep neural network accelerator, which implements an in-memory entry-counting scheme for low bit-width quantized multiplication-and-accumulations (MACs). To maintain good accuracy on ImageNet, the proposed design adopts a full-stack co-design methodology, from algorithms, circuits to architectures. In the algorithm level, an entry-counting based MAC is proposed to fit the learned step-sized quantization scheme, and exploit the sparsity of both activations and weights intrinsically. In the circuit level, content addressable memory cells and multiplexed arrays are developed in the processing-in-memory macro. In the architecture level, the proposed design is compatible with different stationary dataflow mappings, further reducing the memory access. An in-memory entry-counting silicon prototype and its entire peripheral circuits are fabricated in 65nm LP CMOS technology with an active area of $0.76times 0.66$ mm<sup>2</sup>. The 7.36-Kb processing-in-memory macro with 128 search entries can reduce the multiplication number by $12.8times $ . The peak throughput is 3.58 GOPS, achieved at a clock rate of 143MHz and a power supply of 1.23V. The peak energy efficiency of the processing-in-memory macro is 11.6 TOPS/W, achieved at a clock rate of 40MHz and a power supply of 1.01V. Note that the physical design of the entry-counting memory is completed in a standard digital placement and routing flow by augmenting the library with two dedicated memory cells. A 3-bit quantized ResNet-18 on the ImageNet dataset is performed, where the top-1 accuracy is 64.4%.

A 16x16+32bit Multiplication Accumulator Design Adaptable To Technology Portability

A 16/spl times/16+32 bit multiplication accumulator design adaptable to technology portability

A Low Latency High Throughput Multiply-accumulator Unit for Float Point and Integer

High Quality Multiplier Design Based on Improved Circuits

Design of a fast multiplier used in 32Kb/s ADPCM

In-Memory Multi-Bit Multiplication and Accumulation (MAC) Using FeFET for Energy Efficient IoT

Design of a CPL-Based Pipeline Multiplier Accumulator for 32-Bit CPU

An Algorithms and Implementation of 32×32 MAC with 32x8 Multiplier

A Multiple-Precision Multiply and Accumulation Design with Multiply-Add Merged Strategy for AI Accelerating.

UFO-MAC: A Unified Framework for Optimization of High-Performance Multipliers and Multiply-Accumulators

Design of low-power and high-speed multiplier

Architecture and implementation of a vector MAC unit for complex number

A novel vector/SIMD multiply-accumulate unit based on reconfigurable booth array

EasyMAC: Design Exploration-Enabled Multiplier-Accumulator Generator Using a Canonical Architectural Representation: (invited Paper)

HIGH PERFORMANCE MAC UNIT USING MODIFIED SIGN EXTENSION ALGORITHM AND A NEW HIGH-SPEED ALU IN DSP-CORE

A standard cell automated layout for a CMOS 50 MHz 8*8 bit pipelined parallel Dadda multiplier

A high effective algorithm of 32-bit multiply and MAC instructions' VLSI implementation with 32/spl times/8 multiplier-accumulator in DSP applications

A Novel Algorithm for Placement of Mixed Macro Block and Standard Cell Designs

A Computing In-Memory Multibit Multiplication Based on Decoupling and In-Array Storing

A Communication-Aware DNN Accelerator on ImageNet Using In-Memory Entry-Counting Based Algorithm-Circuit-Architecture Co-Design in 65-nm CMOS

An 11T1C Bit-Level-Sparsity-Aware Computing-in-Memory Macro with Adaptive Conversion Time and Computation Voltage