Abstract:Systolic arrays are a promising computing concept which is in particular inline with CMOS technology trends and linear algebra operations found in the processing of artificial neural networks. The recent success of such deep learning methods in a wide set of applications has led to a variety of models, which albeit conceptual similar as based on convolutions and fully-connected layers, in detail show a huge diversity in operations due to a large design space: An operand's dimension varies substantially since it depends on design principles such as receptive field size, number of features, striding, dilating and grouping of features. Last, recent networks extent previously plain feedforward models by various connectivity, such as in ResNet or DenseNet. The problem of choosing an optimal systolic array configuration cannot be solved analytically, thus instead methods and tools are required that facilitate a fast and accurate reasoning about optimality in terms of total cycles, utilization, and amount of data movements. In this work we introduce Camuy, a lightweight model of a weight-stationary systolic array for linear algebra operations that allows quick explorations of different configurations, such as systolic array dimensions and input/output bitwidths. Camuy aids accelerator designers in either finding optimal configurations for a particular network architecture or for robust performance across a variety of network architectures. It offers simple integration into existing machine learning tool stacks (e.g TensorFlow) through custom operators. We present an analysis of popular DNN models to illustrate how it can estimate required cycles, data movement costs, as well as systolic array utilization, and show how the progress in network architecture design impacts the efficiency of inference on accelerators based on systolic arrays.

Systolic Array Based Processing For Linear-Multivariable Feedback-Control Schemes

Design of a GMM Vector Multiplier Based on Two-dimensional Systolic Array

Asynchronous reconfigurable computing array design

CSA-CiM: Enhancing Multi-Functional Computing-in-Memory with Configurable Sense Amplifiers

On the Difficulty of Designing Processor Arrays for Deep Neural Networks

Multiprocessors for Evaluating Compound Arithmetic Functions

Efficient and Low-Latency Systolic Array Architecture for Full Searches in Block-Matching Motion Estimation

Searching Algorithm for Space and Time Mapping in Linear Systolic Array Transformation

Search for Optimal Systolic Arrays: A Comprehensive Automated Exploration Framework and Lessons Learned

Architecture and implementation of a vector MAC unit for complex number

Systolic Computing on GPUs for Productive Performance

Generating Systolic Array Accelerators with Reusable Blocks

ONE-SA: Enabling Nonlinear Operations in Systolic Arrays for Efficient and Flexible Neural Network Inference

ArrayFlex: A Systolic Array Architecture with Configurable Transparent Pipelining

EVALUATION STUDY OF SYSTOLIC ARRAY PROCESSORS OPTIMIZATION AND MAPPING ON k-LUT FPGA DEVICES

FT-Matrix: A Coordination-Aware Architecture for Signal Processing

Low-latency array architecture for telescopic-search-based motion estimation

Single instruction multiple data code auto generation for a very long instruction words digital signal processor in sensor-based systems

A novel vector/SIMD multiply-accumulate unit based on reconfigurable booth array

A comparison of block-matching algorithms mapped to systolic-array implementation

Instruction Scheduling in the Saturn Vector Unit