Abstract:Precison-scalable (PS) multipliers are gaining traction in Deep Neural Network accelerators, particularly for enabling mixed-precision (MP) quantization in Deep Learning at the edge. This paper focuses on the Sum-Together (ST) class of PS multipliers, which are subword-parallel multipliers that can execute a standard multiplication at full precision or a dot-product with parallel low-precision operands. Our contributions in this area encompass multiple aspects: we enrich our previous comparison of SoA ST multipliers by including our recent radix-4 Booth ST multiplier and two novel designs; we extend the explanation of the architecture and the design flow of our previously proposed ST-based PS hardware accelerators designed for 2D-Convolution, Depth-wise Convolution, and Fully-Connected layers that we developed using High-Level Synthesis (HLS); we implement the uniform integer quantization equations in hardware; we conduct a broad HLS-driven design space exploration of our ST-based accelerators, varying numerous hardware parameters; finally, we showcase the advantages of ST-based accelerators when integrated into System-on-Chips (SoCs) in three different scenarios (low-area, low-power, and low-latency), running inference on MP-quantized MLPerf Tiny models as case study. Across the three scenarios, the results show an average latency speedup of 1.46x, 1.33x, and 1.29x, a reduced energy consumption in most of the cases, and a marginal area overhead of 0.9%, 2.5% and 8.0%, compared to SoCs with accelerators based on fixed-precision 16-bit multipliers. To sum up, our work provides a comprehensive understanding of ST-based accelerators' performance in an SoC context, paving the way for future enhancements and the solution of identified inefficiencies.

Monotonicity of Multi-Term Floating-Point Adders

Monotonicity of Multi-Term Floating-Point Adders

A Low Latency High Throughput Multiply-accumulator Unit for Float Point and Integer

Online Alignment and Addition in Multi-Term Floating-Point Adders

Optimally Approximated and Unbiased Floating-Point Multiplier with Runtime Configurability

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

Secure and Accurate Summation of Many Floating-Point Numbers

Deterministic and Probabilistic Error Bounds for Floating Point Summation Algorithms

A New Distillation Algorithm for Floating-Point Summation.

PAM: A Piecewise-Linearly-Approximated Floating-Point Multiplier with Unbiasedness and Configurability

Design of A Fully Pipelined Single-Precision Multiply-Add-Fused Unit

Dual-mode floating-point adder architectures

Twofold fast summation

Procrastination Is All You Need: Exponent Indexed Accumulators for Floating Point, Posits and Logarithmic Numbers

Floating-Point Multiply-Add with Approximate Normalization for Low-Cost Matrix Engines

Optimized Design of a Double-Precision Floating-Point Multiply-Add-dused Unit for Data Dependence.

The pitfalls of verifying floating-point computations

Inexactness and Correction of Floating-Point Reciprocal, Division and Square Root

Characterizing Approximate Adders and Multipliers Optimized under Different Design Constraints

Exploiting Binary Floating-Point Representations for Constraint Propagation: The Complete Unabridged Version

High-Level Design of Precision-Scalable DNN Accelerators Based on Sum-Together Multipliers