Abstract:In recent years, there has been a surging demand for edge computing of image processing and machine learning workloads. This has reignited interest in the development of custom hardware accelerators that can deliver enhanced performance and improved energy efficiency. These workloads frequently demonstrate affine memory accesses and constant loop bounds. In this paper, we introduce an ILP-based automatic scheduler for high-level synthesis, with a specific emphasis on aggressive pipelining to enhance parallelism. In this study, we propose a unified Integer Linear Programming (ILP) formulation that can identify pipelining opportunities along multiple loop and scalar dimensions. Our multi-dimensional pipelining technique encompasses both inner loop pipelining and dataflow optimizations of Vitis HLS, while also being capable of handling more general memory access patterns compared to the dataflow optimization in Vitis HLS. Furthermore, our approach enables the generation of statically scheduled circuits, leading to improved resource efficiency. We have integrated our scheduler into a high-level synthesis compiler framework (HIR) based on MLIR and conducted performance evaluations. Our findings reveal that our scheduler, in comparison to Vitis HLS, can achieve more aggressive pipelining across multiple producer-consumer loop nests, resulting in reduced overall execution latency. The producer-consumer pipelined execution facilitated by our scheduler yields an average performance improvement of 2.42X across a set of representative benchmarks when compared to only loop pipelining. Furthermore, we achieved an average performance improvement of 1.30X over Vitis HLS with dataflow optimizations.

Latency Minimal Scheduling with Maximum Instruction Parallelism

Dependency Graph-based High-level Synthesis for Maximum Instruction Parallelism

Compiler Discovered Dynamic Scheduling of Irregular Code in High-Level Synthesis

Subgraph Extraction-based Feedback-guided Iterative Scheduling for HLS

GSA to HDL: Towards principled generation of dynamically scheduled circuits

Optimizing Scheduling Technology for Clustered VLIW Architectures Using Data Dependence Graph

Minimizing Write Operation for Multi-Dimensional DSP Applications Via a Two-Level Partition Technique with Complete Memory Latency Hiding

Automatic multi-dimensional pipelining for high-level synthesis of dataflow accelerators

A gradual scheduling framework for problem size reduction and cross basic block parallelism exploitation in high-level synthesis

Max-Flow Scheduling in High-Level Synthesis

Hybrid Optimization/heuristic Instruction Scheduling for Programmable Accelerator Codesign

Scheduling Information-Guided Efficient High-Level Synthesis Design Space Exploration

A Latency-Optimal Task Offloading Scheme Using Genetic Algorithm for DAG Applications in Edge Computing

Directed Acyclic Task Graph Scheduling for Heterogeneous Computing Systems by Dynamic Critical Path Duplication Algorithm

Optimizing VLIW Instruction Scheduling via a Two-Dimensional Constrained Dynamic Programming

Multilevel Granularity Parallelism Synthesis on FPGAs

Optimization on Operation Sorting for Hls Scheduling Algorithms

An Optimal Lower-Bound Algorithm for the High-Level Synthesis Scheduling Problem.

Exploit the Data Level Parallelism and Schedule Dependent Tasks on the Multi-Core Processors

Evaluating DAG Scheduling Algorithms for Maximum Parallelism.

Backtracking Optimized DDG Directed Scheduling Algorithm for Clustered VLIW Architectures