Abstract:The posit number system aims to be a drop-in replacement of the existing IEEE floating-point standard. Its properties- tapered precision and high dynamic range, allow a smaller size posit to almost match the performance of a much larger size floating-point in representing decimals. This becomes especially useful for performing error-tolerant tasks like deep learning inference computation where low latency and area are a priority. Recent research has found that the performance of deep neural network models saturates beyond a certain level of accuracy of multipliers used for convolutions. Therefore, the extra hardware cost of developing precise arithmetic circuits for such applications becomes an unnecessary overhead. This paper explores approximate posit multipliers in the convolutional layers of deep neural networks and attempts to find an ideal balance between hardware utilization and inference accuracy. Posit multiplication involves several steps, with the mantissa multiplication step utilizing maximum hardware resources. To mitigate this, a posit multiplier circuit using an approximate hybrid-radix Booth encoding for mantissa multiplication and techniques such as truncation and bit masking based on input regime size are proposed. In addition, a novel Booth encoding control scheme to prevent unnecessary bits from switching has been devised to reduce dynamic power dissipation. Compared to existing literature, these optimizations have contributed to a 23% decrease in power dissipation in the mantissa multiplication stage. Further, a novel area and energy-efficient decoder architecture have also been developed with an 11% reduction in dynamic power dissipation and area compared to existing decoders. Overall, the proposed posit multiplier offers a 14% reduction in the PDP over the existing approximate posit multiplier designs. The proposed multiplier also achieves over 90% accuracy in inferencing deep learning models such as ResNet20, VGG-19 and DenseNet.

A Logarithmic Floating-Point Multiplier for the Efficient Training of Neural Networks

A Design Framework for Hardware-Efficient Logarithmic Floating-Point Multipliers

Hardware-Efficient Logarithmic Floating-Point Multipliers for Error-Tolerant Applications

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Low-Power Arithmetic Element for Multi-Base Logarithmic Computation on Deep Neural Networks

Base-Reconfigurable Segmented Logarithmic Quantization and Hardware Design for Deep Neural Networks

Optimal Architecture of Floating-Point Arithmetic for Neural Network Training Processors

Area-Efficient Iterative Logarithmic Approximate Multipliers for IEEE 754 and Posit Numbers

On the Design of Logarithmic Multiplier Using Radix-4 Booth Encoding

A Stochastic Rounding-Enabled Low-Precision Floating-Point MAC for DNN Training

Training Deep Neural Networks with 8-bit Floating Point Numbers

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

ADEPNET: A Dynamic-Precision Efficient Posit Multiplier for Neural Networks

A 19.7 TFLOPS/W Multiply-less Logarithmic Floating-Point CIM Architecture with Error-Reduced Compensated Approximate Adder

Adaptable Approximate Multiplier Design Based on Input Distribution and Polarity

LPE: Logarithm Posit Processing Element for Energy-Efficient Edge-Device Training

Accuracy Booster: Enabling 4-bit Fixed-point Arithmetic for DNN Training

Ultra-low Precision Multiplication-free Training for Deep Neural Networks

AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers

A Fine-Grained Sparse Accelerator for Multi-Precision DNN.

PL-NPU: an Energy-Efficient Edge-Device DNN Training Processor with Posit-Based Logarithm-Domain Computing