Abstract:CPU-FPGA heterogeneous architectures are attracting ever-increasing attention in an attempt to advance computational capabilities and energy efficiency in today's datacenters. These architectures provide programmers with the ability to reprogram the FPGAs for flexible acceleration of many workloads. Nonetheless, this advantage is often overshadowed by the poor programmability of FPGAs whose programming is conventionally a RTL design practice. Although recent advances in high-level synthesis (HLS) significantly improve the FPGA programmability, it still leaves programmers facing the challenge of identifying the optimal design configuration in a tremendous design space. This paper aims to address this challenge and pave the path from software programs towards high-quality FPGA accelerators. Specifically, we first propose the composable, parallel and pipeline (CPP) microarchitecture as a template of accelerator designs. Such a well-defined template is able to support efficient accelerator designs for a broad class of computation kernels, and more importantly, drastically reduce the design space. Also, we introduce an analytical model to capture the performance and resource trade-offs among different design configurations of the CPP microarchitecture, which lays the foundation for fast design space exploration. On top of the CPP microarchitecture and its analytical model, we develop the AutoAccel framework to make the entire accelerator generation automated. AutoAccel accepts a software program as an input and performs a series of code transformations based on the result of the analytical-model-based design space exploration to construct the desired CPP microarchitecture. Our experiments show that the AutoAccel-generated accelerators outperform their corresponding software implementations by an average of 72x for a broad class of computation kernels.

PAAS: A system level simulator for heterogeneous computing architectures

An accelerator-aware microarchitecture simulator for design space exploration

A novel cross-layer framework for early-stage power delivery and architecture co-exploration.

HeteroSim: A Heterogeneous CPU-FPGA Simulator

AutoAccel: Automated Accelerator Generation and Optimization with Composable, Parallel and Pipeline Architecture

PCAsim: A parallel cycle accurate simulation platform for CMPs

A Hybrid Approach to Cache Management in Heterogeneous CPU-FPGA Platforms.

Centrifuge: Evaluating full-system HLS-generated heterogenous-accelerator SoCs using FPGA-Acceleration

Analyzing Parallelization and Program Performance in Heterogeneous MPSoCs

Scalable Light-Weight Integration of FPGA Based Accelerators with Chip Multi-Processors

Performance Modelling of Parallel and Distributed Computing Using PACE1

Design Space Exploration of HW Accelerators and Network Infrastructure for FPGA-Based MPSoC

CAMAS: Static and Dynamic Hybrid Cache Management for CPU-FPGA Platforms

gem5-NVDLA: A Simulation Framework for Compiling, Scheduling and Architecture Evaluation on AI System-on-Chips

Kernel-as-a-Service: A Serverless Programming Model for Heterogeneous Hardware Accelerators

Design Space Exploration of FPGA-based Accelerators with Multi-Level Parallelism

An Approach to Build Cycle Accurate Full System VLIW Simulation Platform.

Modelling of ASCI High Performance Applications Using PACE

CAMASim: A Comprehensive Simulation Framework for Content-Addressable Memory based Accelerators

HosNa: A DPC++ Benchmark Suite for Heterogeneous Architectures

DSAGEN: Synthesizing Programmable Spatial Accelerators