Abstract:CPU-FPGA heterogeneous architectures are attracting ever-increasing attention in an attempt to advance computational capabilities and energy efficiency in today's datacenters. These architectures provide programmers with the ability to reprogram the FPGAs for flexible acceleration of many workloads. Nonetheless, this advantage is often overshadowed by the poor programmability of FPGAs whose programming is conventionally a RTL design practice. Although recent advances in high-level synthesis (HLS) significantly improve the FPGA programmability, it still leaves programmers facing the challenge of identifying the optimal design configuration in a tremendous design space. This paper aims to address this challenge and pave the path from software programs towards high-quality FPGA accelerators. Specifically, we first propose the composable, parallel and pipeline (CPP) microarchitecture as a template of accelerator designs. Such a well-defined template is able to support efficient accelerator designs for a broad class of computation kernels, and more importantly, drastically reduce the design space. Also, we introduce an analytical model to capture the performance and resource trade-offs among different design configurations of the CPP microarchitecture, which lays the foundation for fast design space exploration. On top of the CPP microarchitecture and its analytical model, we develop the AutoAccel framework to make the entire accelerator generation automated. AutoAccel accepts a software program as an input and performs a series of code transformations based on the result of the analytical-model-based design space exploration to construct the desired CPP microarchitecture. Our experiments show that the AutoAccel-generated accelerators outperform their corresponding software implementations by an average of 72x for a broad class of computation kernels.

DSAGEN: Synthesizing Programmable Spatial Accelerators

An accelerator-aware microarchitecture simulator for design space exploration

DAEGEN: A Modular Compiler for Exploring Decoupled Spatial Accelerators.

Unifying Spatial Accelerator Compilation With Idiomatic and Modular Transformations

Automatic generation of efficient accelerators for reconfigurable hardware

AutoDSE: Enabling Software Programmers to Design Efficient FPGA Accelerators

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

Early DSE and Automatic Generation of Coarse Grained Merged Accelerators

Design and Application Space Exploration of a Domain-Specific Accelerator System

Allo: A Programming Model for Composable Accelerator Design

Towards General Purpose Acceleration by Exploiting Common Data-Dependence Forms

Design Space Exploration of FPGA-based Accelerators with Multi-Level Parallelism

Spatial: a language and compiler for application accelerators

Archytas: A Framework for Synthesizing and Dynamically Optimizing Accelerators for Robotic Localization.

OverGen: Improving FPGA Usability Through Domain-specific Overlay Generation.

Software-defined Design Space Exploration for an Efficient DNN Accelerator Architecture

AutoAccel: Automated Accelerator Generation and Optimization with Composable, Parallel and Pipeline Architecture

A decoupled access-execute architecture for reconfigurable accelerators

Domain-specific hardware accelerators

GAHLS: an optimized graph analytics based high level synthesis framework

Automatic Generation of Spatial Accelerator for Tensor Algebra