Abstract:The fast-growing tensor applications expose tremendous dataflow alternatives when implemented on spatial architectures that feature large PE arrays and abundant interconnection resources. Prior works develop various notations and performance models for dataflows. Though these notations are very useful for understanding the reuse, bandwidth, and performance of dataflows, they do not define the underlying hardware implementation. Due to the semantic gap, analysis based on these notations cannot capture the detailed architectural features between different dataflows, leading to inefficient design space exploration and suboptimal designs. To address these issues, we propose Rubick, a unified infrastructure for analyzing, exploring, and implementing spatial architectures. The main innovation of Rubick is it decomposes the dataflow into two low-level intermediate representations: access entry and data layout. Access entry specifies how data enter into the PE arrays from memory, while data layout specifies how data are arranged and accessed. These two representations allow us to infer the hardware implementation details such as PE interconnection and memory structure, which are amenable for structural analysis and systematic exploration. Based on this decomposition analysis, Rubick provides opportunities for micro-architecture optimization and efficient design space exploration. Our experiments demonstrate that Rubick can reduce 82.4% of wire resources with only a 2.7% latency increase by optimizing access entry IR, and achieve 70.8% memory overhead reduction by optimizing data layout IR. Rubick also accelerates the DSE time of dataflows by up to 1.1×105X, saving the time from several days to minutes. The source code of Rubick is publically available on (https://link-omitted-for-blind-review).

Rubick: A Synthesis Framework for Spatial Architectures Via Dataflow Decomposition.

Rubick: A Unified Infrastructure for Analyzing, Exploring, and Implementing Spatial Architectures Via Dataflow Decomposition

Towards Efficient Control Flow Handling in Spatial Architecture via Architecting the Control Flow Plane

An Irredundant Decomposition of Data Flow with Affine Dependences

An Architecture-Agnostic Dataflow Mapping Framework on CGRA

Polyhedral-based data reuse optimization for configurable computing

EMS: Efficient Memory Subsystem Synthesis for Spatial Accelerators

Rethinking Control Flow in Spatial Architectures: Insights into Control Flow Plane Design

Skew-Oblivious Data Routing for Data-Intensive Applications on FPGAs with HLS

Analyzing the Design Space of Spatial Tensor Accelerators on FPGAs

A method to build reconfigurable architectures by extracting common subgraphs

Spatial: a language and compiler for application accelerators

Evaluation Mappings of Spatial Accelerator Based On Data Placement

TileFlow: A Framework for Modeling Fusion Dataflow Via Tree-based Analysis.

TensorLib - A Spatial Accelerator Generation Framework for Tensor Algebra.

Low-Depth Spatial Tree Algorithms

R-HLS: An IR for Dynamic High-Level Synthesis and Memory Disambiguation based on Regions and State Edges

Date Flow Optimization of Dynamically Coarse Grain Reconfigurable Architecture for Multimedia Applications.

DATC RDF: An Open Design Flow from Logic Synthesis to Detailed Routing

Efficient Hardware Accelerator Based on Medium Granularity Dataflow for SpTRSV

Rubik: A Hierarchical Architecture for Efficient Graph Neural Network Training