Abstract:High level synthesis (HLS) is an important enabling technology for the adoption of hardware accelerator technologies. It promises the performance and energy efficiency of hardware designs with a lower barrier to entry in design expertise, and shorter design time. State-of-the-art high level synthesis now includes a wide variety of powerful optimizations that implement efficient hardware. These optimizations can implement some of the most important features generally performed in manual designs including parallel hardware units, pipelining of execution both within a hardware unit and between units, and fine-grained data communication. We may generally classify the optimizations as those that optimize hardware implementation within a code block (intra-block) and those that optimize communication and pipelining between code blocks (inter-block). However, both optimizations are in practice difficult to apply. Real-world applications contain data-dependent blocks of code and communicate through complex data access patterns. Existing high level synthesis tools cannot apply these powerful optimizations unless the code is inherently compatible, severely limiting the optimization opportunity. In this paper we present an integrated framework to model and enable both intra- and inter-block optimizations. This integrated technique substantially improves the opportunity to use the powerful HLS optimizations that implement parallelism, pipelining, and fine-grained communication. Our polyhedral model-based technique systematically defines a set of data access patterns, identifies effective data access patterns, and performs the loop transformations to enable the intra- and inter-block optimizations. Our framework automatically explores transformation options, performs code transformations, and inserts the appropriate HLS directives to implement the HLS optimizations. Furthermore, our framework can automatically generate the optimized communication blocks for fine-grained communication between hardware blocks. Experimental evaluation demonstrates that we can achieve an average of 6.04X speedup over the high level synthesis solution without our transformations to enable intra- and inter-block optimizations.

Hi-DMM: High-Performance Dynamic Memory Management in High-Level Synthesis.

A Scalable, Efficient, and Robust Dynamic Memory Management Library for HLS-based FPGAs

An accelerator-aware microarchitecture simulator for design space exploration

Memory fartitioning-based modulo scheduling for high-level synthesis.

Automatic Data Placement For Cpu-Fpga Heterogeneous Multiprocessor System-On-Chips

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

Generation of memory architecture in operator design methodology

Joint Modulo Scheduling And Memory Partitioning With Multi-Bank Memory For High-Level Synthesis

Nonvolatile memory allocation and hierarchy optimization for high-level synthesis

Revisiting FPGA Acceleration of Molecular Dynamics Simulation with Dynamic Data Flow Behavior in High-Level Synthesis

Leveraging emerging nonvolatile memory in high-level synthesis with loop transformations

Automatic Creation of High-Bandwidth Memory Architectures from Domain-Specific Languages: The Case of Computational Fluid Dynamics

Multi-Bank Memory Aware Force Directed Scheduling for High-Level Synthesis.

Automatic multidimensional memory partitioning for FPGA-based accelerators (abstract only).

Compiling Halide Programs to Push-Memory Accelerators

Memory partitioning for multidimensional arrays in high-level synthesis

Augmenting HLS with Zero-Overhead Application-Specific Address Mapping for Optane DCPMM

R-HLS: An IR for Dynamic High-Level Synthesis and Memory Disambiguation based on Regions and State Edges

Improving High Level Synthesis Optimization Opportunity Through Polyhedral Transformations.

Accelerating thread-intensive and explicit memory management programs with dynamic partial reconfiguration

EMS: Efficient Memory Subsystem Synthesis for Spatial Accelerators