Abstract:In response to the escalating demand for hardware-efficient Deep Neural Network (DNN) architectures, we present a novel quantize-enabled multiply-accumulate (MAC) unit. Our methodology employs a right shift-and-add computation for MAC operation, enabling runtime truncation without additional hardware. This architecture optimally utilizes hardware resources, enhancing throughput performance while reducing computational complexity through bit-truncation techniques. Our key methodology involves designing a hardware-efficient MAC computational algorithm that supports both iterative and pipeline implementations, catering to diverse hardware efficiency or enhanced throughput requirements in accelerators. Additionally, we introduce a processing element (PE) with a pre-loading bias scheme, reducing one clock delay and eliminating the need for conventional extra resources in PE implementation. The PE facilitates quantization-based MAC calculations through an efficient bit-truncation method, removing the necessity for extra hardware logic. This versatile PE accommodates variable bit-precision with a dynamic fraction part within the sfxpt< N,f representation, meeting specific model or layer demands. Through software emulation, our proposed approach demonstrates minimal accuracy loss, revealing under 1.6% loss for LeNet-5 using MNIST and around 4% for ResNet-18 and VGG-16 with CIFAR-10 in the sfxpt< 8 ,5 format compared to conventional float32-based implementations. Hardware performance parameters on the Xilinx-Virtex-7 board unveil a 37% reduction in area utilization and a 45% reduction in power consumption compared to the best state-of-the-art MAC architecture. Extending the proposed MAC to a LeNet DNN model results in a 42% reduction in resource requirements and a significant 27% reduction in delay. This architecture provides notable advantages for resource-efficient, high-throughput edge-AI applications.

Work-in-Process: Error-Compensation-Based Energy-Efficient MAC Unit for CNNs

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

An Energy-Efficient Mixed-Signal Parallel Multiply-Accumulate (MAC) Engine Based on Stochastic Computing

Hybrid Stochastic-Binary Computing for Low-Latency and High-Precision Inference of CNNs

QuantMAC: Enhancing Hardware Performance in DNNs With Quantize Enabled Multiply-Accumulate Unit

Unified energy-efficient reconfigurable MAC for dynamic Convolutional Neural Network based on Winograd algorithm

EncodingNet: A Novel Encoding-based MAC Design for Efficient Neural Network Acceleration

AxR-NN: Approximate Computation Reuse for Energy-Efficient Convolutional Neural Networks

Approximate Processing Element Design and Analysis for the Implementation of CNN Accelerators

Dynamic Power Control in a Hardware Neural Network with Error-Configurable MAC Units

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks

A Low-Power Sparse Convolutional Neural Network Accelerator with Pre-Encoding Radix-4 Booth Multiplier

PPBAM:A Preprocessing-based Power-Efficient Approximate Multiplier Design for CNN

Joint Optimization of Dimension Reduction and Mixed-Precision Quantization for Activation Compression of Neural Networks

Memory System Designed for Multiply-Accumulate (MAC) Engine Based on Stochastic Computing.

Genetic Algorithm-Based Energy-Aware CNN Quantization for Processing-In-Memory Architecture

A Multiply-Less Approximate SRAM Compute-In-Memory Macro for Neural-Network Inference

A Hardware- and Accuracy-Efficient Approximate Multiplier with Error Compensation for Neural Network and Image Processing Applications

Energy-Efficient Architecture for FPGA-based Deep Convolutional Neural Networks with Binary Weights

Optimizing Stochastic Computing for Low Latency Inference of Convolutional Neural Networks