Abstract:Coarse-grained reconfigurable architectures (CGRAs) are increasingly employed as domain-specific accelerators due to their efficiency and flexibility. A CGRA typically relies on compilers to perform task scheduling. The longstanding problem of static scheduling is that it suffers from insufficient parallelism in handling irregularities due to over-serialization and workload imbalance, which leads to severe resource underutilization and performance loss. To counteract the limitations of static scheduling in CGRAs, it is essential to exploit dynamic parallelism automatically and manage hardware resources adaptively. However, existing dynamic scheduling mechanisms, e.g., work stealing, often reschedule aggressively for instant performance but sacrifice efficiency, which is unfavorable to CGRAs that emphasize efficiency and fewer reconfigurations. This article proposes an elastic task scheduling scheme that enables lightweight dynamic scheduling in CGRAs. Tasks are rescheduled at runtime according to the classic tagged-token dataflow paradigm to enable dynamic task-level parallelism. Meanwhile, tasks are dynamically resized according to run-time throughputs via duplication, combination, and substitution operators for balanced multitask execution. We implement the elastic task scheduling scheme on a well-known reconfigurable architecture - triggered instruction architecture (TIA). Evaluation on the MachSuite benchmarks shows that the proposed scheme is effective in improving performance and energy efficiency. The average speedup is 2× over the baseline. Also, our design attains a 57 percent improvement in the area-normalized performance and a 49 percent better energy efficiency. Compared with a state-of-the-art dynamic scheduling method, our scheme achieves 1.6× speedup and 1.6× energy efficiency than work-stealing mechanism on the same substrate.

HiEval: A scheduling performance estimation approach for spatial accelerators via hierarchical abstraction

Evaluation Mappings of Spatial Accelerator Based On Data Placement

Real Time Performance Evaluation for Dynamic Scheduling Algorithm

Evaluating Spatial Accelerator Architectures with Tiled Matrix-Matrix Multiplication

Inter-layer Scheduling Space Definition and Exploration for Tiled Accelerators.

Low-power Scheduling Framework for Heterogeneous Architecture under Performance Constraint

HSAS: Efficient task scheduling for large scale heterogeneous systolic array accelerator cluster

An Adaptive Performance-oriented Scheduler for Static and Dynamic Heterogeneity

Performance evaluation based on task division and scheduling in heterogeneous multi-core systems

Low Power Scheduling Approach for Heterogeneous System Based on Heuristic and Greedy Method

Pipeline Balancing for Integrated Mapping in High Performance Spatial Programmable Architecture

RealArch: A Real-Time Scheduler for Mapping Multi-Tenant DNNs on Multi-Core Accelerators

A HPC Co-Scheduler with Reinforcement Learning

Efficient Mapping Space Exploration for a Reconfigurable Neural Accelerator

Energy-aware Task Scheduling with Deadline Constraint in DVFS-enabled Heterogeneous Clusters

Job Scheduling in High Performance Computing

CCASM: A Computation- and Communication-Aware Scheduling and Mapping Algorithm for NoC-Based DNN Accelerators

Energy-Aware Non-Preemptive Task Scheduling with Deadline Constraint in DVFS-Enabled Heterogeneous Clusters

Orchestrated Co-scheduling, Resource Partitioning, and Power Capping on CPU-GPU Heterogeneous Systems via Machine Learning

An Elastic Task Scheduling Scheme on Coarse-Grained Reconfigurable Architectures

Serving Multi-DNN Workloads on FPGAs: A Coordinated Architecture, Scheduling, and Mapping Perspective.