Abstract:CPU-FPGA heterogeneous architectures are attracting ever-increasing attention in an attempt to advance computational capabilities and energy efficiency in today's datacenters. These architectures provide programmers with the ability to reprogram the FPGAs for flexible acceleration of many workloads. Nonetheless, this advantage is often overshadowed by the poor programmability of FPGAs whose programming is conventionally a RTL design practice. Although recent advances in high-level synthesis (HLS) significantly improve the FPGA programmability, it still leaves programmers facing the challenge of identifying the optimal design configuration in a tremendous design space. This paper aims to address this challenge and pave the path from software programs towards high-quality FPGA accelerators. Specifically, we first propose the composable, parallel and pipeline (CPP) microarchitecture as a template of accelerator designs. Such a well-defined template is able to support efficient accelerator designs for a broad class of computation kernels, and more importantly, drastically reduce the design space. Also, we introduce an analytical model to capture the performance and resource trade-offs among different design configurations of the CPP microarchitecture, which lays the foundation for fast design space exploration. On top of the CPP microarchitecture and its analytical model, we develop the AutoAccel framework to make the entire accelerator generation automated. AutoAccel accepts a software program as an input and performs a series of code transformations based on the result of the analytical-model-based design space exploration to construct the desired CPP microarchitecture. Our experiments show that the AutoAccel-generated accelerators outperform their corresponding software implementations by an average of 72x for a broad class of computation kernels.

FlexPDA: A Flexible Programming Framework for Deep Learning Accelerators.

A design framework for processing-in-memory accelerator

FlexNN: A Dataflow-aware Flexible Deep Learning Accelerator for Energy-Efficient Edge Devices

Woodpecker-DL: Accelerating Deep Neural Networks via Hardware-Aware Multifaceted Optimizations

ElasticAI: Creating and Deploying Energy-Efficient Deep Learning Accelerator for Pervasive Computing

Flex-PE: Flexible and SIMD Multi-Precision Processing Element for AI Workloads

Polymorphic Accelerators for Deep Neural Networks

A Formalism of DNN Accelerator Flexibility

Flexible Acceleration Framework for Dense/Sparse Matrix Multiplication on Versal ACAP

DLPF：A Parallel Deep Learning Programming Framework Based on Heterogeneous Architecture

A Versatile Acceleration Framework for Machine Learning Algorithms

Ifpna: A Flexible and Efficient Deep Neural Network Accelerator with a Programmable Data Flow Engine in 28nm CMOS.

Survey and design of paleozoic: a high-performance compiler tool chain for deep learning inference accelerator

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

Flex-TPU: A Flexible TPU with Runtime Reconfigurable Dataflow Architecture

AutoAccel: Automated Accelerator Generation and Optimization with Composable, Parallel and Pipeline Architecture

Efficient and Fast High-performance Library Generation for Deep Learning Accelerators

DLFusion: an Auto-Tuning Compiler for Layer Fusion on Deep Neural Network Accelerator

NEST‐C: A deep learning compiler framework for heterogeneous computing systems with artificial intelligence accelerators

DLAU: A Scalable Deep Learning Accelerator Unit on FPGA.

A Fine-Grained End-to-End Latency Optimization Framework for Wireless Collaborative Inference