Abstract:Post-training quantization (PTQ) has been proven an efficient model compression technique for Convolution Neural Networks (CNNs), without re-training or access to labeled datasets. However, it remains challenging for a CNN accelerator to fulfill the efficiency potential of PTQ methods. A large number of PTQ techniques blindly pursue high theoretic compression effect and accuracy, ignoring their impact on the actual hardware implementation, which causes more hardware overhead than benefit. This paper introduces ASLog, a PTQ-friendly CNN accelerator that explores four key designs in an algorithm-hardware co-optimizing manner: the first practical 4-bit logarithmic PTQ pipeline SLogII, the multiplier-free arithmetic element (AE) design, the energy-efficient bias correction element (BCE) design, and the per-channel quantization friendly (PCF) architecture and dataflow. The proposed SLogII PTQ pipeline can push the limit of logarithmic PTQ to 4-bit with < 2.5% accuracy degradation on various image classification and face recognition tasks. Exploiting the approximate computing design and a novel encoding and decoding scheme, the proposed SLogII AE is >40% lower in power and area consumption compared with a common 8-bit multiplier. The BCE and PCF design proposed in this paper are the first to consider the hardware impact of the widely-used per-channel quantization and bias correction technique, enabling an efficient PTQ-friendly implementation with a small hardware overhead. The ASLog is validated in a UMC 40-nm process, with 12.2 TOPS/W energy efficiency and 0.80 mm2 core area. The ASLog can achieve 336.3 GOPS/mm2 area efficiency and >500 OPs/Byte operational intensity, which map to over $1.85\times $ and $1.12\times $ improvement compared with the previous related works.

A Low-Power Arithmetic Element for Multi-Base Logarithmic Computation on Deep Neural Networks

Base-Reconfigurable Segmented Logarithmic Quantization and Hardware Design for Deep Neural Networks

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

A Logarithmic Floating-Point Multiplier for the Efficient Training of Neural Networks

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Algorithm-Hardware Co-Design of Distribution-Aware Logarithmic-Posit Encodings for Efficient DNN Inference

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

ASLog: an Area-Efficient CNN Accelerator for Per-Channel Logarithmic Post-Training Quantization

Hardware-Efficient Logarithmic Floating-Point Multipliers for Error-Tolerant Applications

A Design Framework for Hardware-Efficient Logarithmic Floating-Point Multipliers

A hardware-friendly logarithmic quantization method for CNNs and FPGA implementation

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

On the Design of Logarithmic Multiplier Using Radix-4 Booth Encoding

A Memory-Efficient CNN Accelerator Using Segmented Logarithmic Quantization and Multi-Cluster Architecture

A Very Compact Embedded CNN Processor Design Based on Logarithmic Computing

LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update

A Low Power In-Memory Multiplication andAccumulation Array with Modified Radix-4 Inputand Canonical Signed Digit Weights

Design Automation for Binarized Neural Networks: A Quantum Leap Opportunity?

A Communication-Aware DNN Accelerator on ImageNet Using In-Memory Entry-Counting Based Algorithm-Circuit-Architecture Co-Design in 65-nm CMOS

AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers