Abstract:Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in computations and make use of reduced precision arithmetic to scale down the energy consumption. However, future platforms require more than just energy efficiency: Scalability is becoming an increasingly important factor. The required effort for physical implementation grows with the size of the accelerator making it more difficult to meet target constraints. Using many-core platforms consisting of several homogeneous cores can alleviate the aforementioned limitations with regard to physical implementation at the expense of an increased dataflow mapping effort. While the dataflow in CNNs is deterministic and can therefore be optimized offline, the problem of finding a suitable scheme that minimizes both runtime and off-chip memory accesses is a challenging task which becomes even more complex if an interconnect system is involved. This work presents an automated mapping strategy starting at the single-core level with different optimization targets for minimal runtime and minimal off-chip memory accesses. The strategy is then extended towards a suitable many-core mapping scheme and evaluated using a scalable system-level simulation with a network-on-chip interconnect. Design space exploration is performed by mapping the well-known CNNs AlexNet and VGG-16 to platforms of different core counts and computational power per core in order to investigate the trade-offs. Our mapping strategy and system setup is scaled starting from the single core level up to 128 cores, thereby showing the limits of the selected approach.

Learning Convolutional Neural Networks for Data-Flow Graph Mapping on Spatial Programmable Architectures (abstract Only)

DFGNet: Mapping Dataflow Graph Onto CGRA by a Deep Learning Approach

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

Data-Flow Graph Mapping Optimization for CGRA with Deep Reinforcement Learning

An Efficient Algorithm for Mapping Deep Learning Applications on the NoC Architecture

TransMap: an Efficient CGRA Mapping Framework Via Transformer and Deep Reinforcement Learning

An Architecture-Agnostic Dataflow Mapping Framework on CGRA

A Comprehensive Dataflow-Mapping Optimization for Fully-Pipelined Execution in Spatial Programmable Architecture

OrderMap: A CGRA Mapping Algorithm based on DFG Analysis and Graph Homomorphism

Reinforcement Learning Approach for Mapping Applications to Dataflow-Based Coarse-Grained Reconfigurable Array

Dataflow Aware Mapping of Convolutional Neural Networks Onto Many-Core Platforms With Network-on-Chip Interconnect

Understanding the Design-Space of Sparse/Dense Multiphase GNN dataflows on Spatial Accelerators

GEML: GNN-based efficient mapping method for large loop applications on CGRA

Towards High-Quality CGRA Mapping with Graph Neural Networks and Reinforcement Learning

FP-DNN: an Automated Framework for Mapping Deep Neural Networks Onto FPGAs with RTL-HLS Hybrid Templates

DFModel: Design Space Optimization of Large-Scale Systems Exploiting Dataflow Mappings

Environment ( CGRA ) Agent ( Mapping algorithm ) Action : PE Interchange Reward :

DCP: Learning Accelerator Dataflow for Neural Network via Propagation

Towards Efficient Control Flow Handling in Spatial Architecture via Architecting the Control Flow Plane

Deep Data Flow Analysis

Approaching the mapping limit with closed-loop mapping strategy for deploying neural networks on neuromorphic hardware