Abstract:The ever-increasing computational complexity and energy consumption of today’s applications, such as machine learning (ML) algorithms, not only strain the capabilities of the underlying hardware but also significantly restrict their wide deployment at the edge. Addressing these challenges, novel architecture solutions are required by leveraging opportunities exposed by algorithms, e.g., robustness to small-bitwidth operand quantization and high intrinsic data-level parallelism. However, traditional hardware single instruction multiple data (Hard SIMD) architectures only support a small set of operand bitwidths, limiting performance improvement. To fill the gap, this manuscript introduces a novel pipelined processor microarchitecture for arithmetic computing based on the software-defined SIMD (Soft SIMD) paradigm that can define arbitrary SIMD modes through control instructions at run-time. This microarchitecture is optimized for parallel fine-grained fixed-point arithmetic, such as shift/add. It can also efficiently execute sequential shift-add-based multiplication over SIMD subwords, thanks to zero-skipping and canonical signed digit (CSD) coding. A lightweight repacking unit allows changing subword bitwidth dynamically. These features are implemented within a tight energy and area budget. An energy consumption model is established through post-synthesis for performance assessment. We select heterogeneously quantized (HQ) convolutional neural networks (CNNs) from the ML domain as the benchmark and map it onto our microarchitecture. Experimental results showcase that our approach dramatically outperforms traditional Hard SIMD Multiplier-Adder regarding area and energy requirements. In particular, our microarchitecture occupies up to 59.9% less area than a Hard SIMD that supports fewer SIMD bitwidths, while consuming up to 50.1% less energy on average to execute HQ CNNs.

Accelerating Householder Bidiagonalization with ARM NEON Technology.

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

Acceleration Of Hevc Transform And Inverse Transform On Arm Neon Platform

An efficient NEON-based quarter-pel interpolation method for HEVC

High Definition IEEE AVS Decoder on ARM NEON Platform

A Novel Fully Hardware-Implemented SVD Solver Based on Ultra-Parallel BCV Jacobi Algorithm

AVS Video Decoding Acceleration on ARM Cortex-A with NEON

Architecture-Aware Optimization of an HEVC decoder on Asymmetric Multicore Processors

Accelerating CDVS Extraction on Mobile Platform

A Hybrid Vectorized Merge Sort on ARM NEON

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Optimizing Compiler for Shared-Memory Multiple Simd Architecture

Optimizing Half Precision Winograd Convolution on ARM Many-Core Processors

An Energy Efficient Soft SIMD Microarchitecture and Its Application on Quantized CNNs

Improving SIMD Parallelism via Dynamic Binary Translation

Exploiting SIMD Asymmetry in ARM-to-x86 Dynamic Binary Translation

Optimizing Full-Spectrum Matrix Multiplications on ARMv8 Multi-Core CPUs

Implementation of HEVC decoder on x86 processors with SIMD optimization

Hello SME! Generating Fast Matrix Multiplication Kernels Using the Scalable Matrix Extension

Extracting the Potential of Emerging Hardware Accelerators for Symmetric Eigenvalue Decomposition

ABM-SpConv-SIMD: Accelerating Convolutional Neural Network Inference for Industrial IoT Applications on Edge Devices