Abstract:In response to the escalating demand for hardware-efficient Deep Neural Network (DNN) architectures, we present a novel quantize-enabled multiply-accumulate (MAC) unit. Our methodology employs a right shift-and-add computation for MAC operation, enabling runtime truncation without additional hardware. This architecture optimally utilizes hardware resources, enhancing throughput performance while reducing computational complexity through bit-truncation techniques. Our key methodology involves designing a hardware-efficient MAC computational algorithm that supports both iterative and pipeline implementations, catering to diverse hardware efficiency or enhanced throughput requirements in accelerators. Additionally, we introduce a processing element (PE) with a pre-loading bias scheme, reducing one clock delay and eliminating the need for conventional extra resources in PE implementation. The PE facilitates quantization-based MAC calculations through an efficient bit-truncation method, removing the necessity for extra hardware logic. This versatile PE accommodates variable bit-precision with a dynamic fraction part within the sfxpt< N,f representation, meeting specific model or layer demands. Through software emulation, our proposed approach demonstrates minimal accuracy loss, revealing under 1.6% loss for LeNet-5 using MNIST and around 4% for ResNet-18 and VGG-16 with CIFAR-10 in the sfxpt< 8 ,5 format compared to conventional float32-based implementations. Hardware performance parameters on the Xilinx-Virtex-7 board unveil a 37% reduction in area utilization and a 45% reduction in power consumption compared to the best state-of-the-art MAC architecture. Extending the proposed MAC to a LeNet DNN model results in a 42% reduction in resource requirements and a significant 27% reduction in delay. This architecture provides notable advantages for resource-efficient, high-throughput edge-AI applications.

A novel vector/SIMD multiply-accumulate unit based on reconfigurable booth array

A Low Latency High Throughput Multiply-accumulator Unit for Float Point and Integer

Multiply-accumulator using modified booth encoders designed for application in 16-bit RISC processor

Architecture and implementation of a vector MAC unit for complex number

Design of a Reconfigurable Low Power Multiply-Accumulator

A Multiple-Precision Multiply and Accumulation Design with Multiply-Add Merged Strategy for AI Accelerating.

Design of High Speed MAC Unit

A Novel Design of Vector Radix-8 Multiply-Accumulator

A high effective algorithm of 32-bit multiply and MAC instructions' VLSI implementation with 32/spl times/8 multiplier-accumulator in DSP applications

PS-IMC: A 2385.7 TOPS/W/b Precision Scalable In-Memory Computing Macro with Bit-Parallel Inputs and Decomposable Weights for DNNs

A VLSI Architecture for a Run-time Multi-precision Reconfigurable Booth Multiplier.

Low-Cost Binary128 Floating-Point FMA Unit Design with SIMD Support.

The design of multiple-precision floating-point multiplier with SIMD support

A 28nm 8Kb Reconfigurable SRAM Computing-In-Memory Macro With Input-Sparsity Optimized DTC for Multi-mode MAC Operations

Design and Implementation of a Delay Optimized Multiply-Accumulate Unit for High Speed DSPs

CSA-CiM: Enhancing Multi-Functional Computing-in-Memory with Configurable Sense Amplifiers

HIGH PERFORMANCE MAC UNIT USING MODIFIED SIGN EXTENSION ALGORITHM AND A NEW HIGH-SPEED ALU IN DSP-CORE

A 98 Gmacs/W 32-Core Vector Processor In 65 Nm Cmos

A 64X64-Bit Modified Booth Multiplier Utilizing Multiplexer-Select Booth Encoder

QuantMAC: Enhancing Hardware Performance in DNNs With Quantize Enabled Multiply-Accumulate Unit

A Reconfigurable SRAM Computing-in-Memory Macro Supporting Ping-Pong Operation and CIM Pipeline for Multi-mode MAC Operations