Abstract:CPU-FPGA heterogeneous platforms offer a promising solution for high-performance and energy-efficient computing systems by providing specialized accelerators with post-silicon reconfigurability. To unleash the power of FPGA, however, the programmability gap has to be filled so that applications specified in high-level programming languages can be efficiently mapped and scheduled on FPGA. The above problem is even more challenging for irregular applications, in which the execution dependency can only be determined at run time. Thus over-serialized accelerators are generated from existing works that rely on compile time analysis to schedule the computation. In this work, we propose a comprehensive software-hardware co-design framework, which captures parallelism in irregular applications and aggressively schedules pipelined execution on reconfigurable platform. Based on an inherently parallel abstraction packaging parallelism for runtime schedule, our framework significantly differs from existing works that tend to schedule executions at compile time. An irregular application is formulated as a set of tasks with their dependencies specified as rules describing the conditions under which a subset of tasks can be executed concurrently. Then datapaths on FPGA will be generated by transforming applications in the formulation into task pipelines orchestrated by evaluating rules at runtime, which could exploit fine-grained pipeline parallelism as handcrafted accelerators do. An evaluation shows that this framework is able to produce datapath with its quality close to handcrafted designs. Experiments show that generated accelerators are dramatically more efficient than those created by current high-level synthesis tools. Meanwhile, accelerators generated for a set of irregular applications attain 0.5x~1.9x performance compared to equivalent software implementations we selected on a server-grade 10-core processor, with the memory subsystem remaining as the bottleneck.

Performance Evaluation of Pipelined Communication Combined with Computation in OpenCL Programming on FPGA

Multi-FPGA Designs and Scaling of HPC Challenge Benchmarks via MPI and Circuit-Switched Inter-FPGA Networks

An Automatic Mixed Software Hardware Pipeline Builder for CPU-FPGA Platforms

Evaluating FPGA Accelerator Performance with a Parameterized OpenCL Adaptation of the HPCChallenge Benchmark Suite

Using System Hyper Pipelining (SHP) to Improve the Performance of a Coarse-Grained Reconfigurable Architecture (CGRA) Mapped on an FPGA

Application-level pipelining on Hierarchical NoC

From opencl to high-performance hardware on FPGAS

A Performance Analysis Framework For Optimizing Opencl Applications On Fpgas

Cascade: An Application Pipelining Toolkit for Coarse-Grained Reconfigurable Arrays

Pflow: An end-to-end heterogeneous acceleration framework for CNN inference on FPGAs

HPIPE: Heterogeneous Layer-Pipelined and Sparse-Aware CNN Inference for FPGAs

PipeCNN: An OpenCL-Based FPGA Accelerator for Large-Scale Convolution Neuron Networks

Integrating FPGA-based hardware acceleration with relational databases

High Level Programming for Heterogeneous Architectures

Work-in-Progress: Scheduler for Collaborated FPGA-GPU-CPU Based on Intermediate Language

Optimizing Communication for Latency Sensitive HPC Applications on up to 48 FPGAs Using ACCL

Enabling OpenMP Task Parallelism on Multi-FPGAs

H2PIPE: High throughput CNN Inference on FPGAs with High-Bandwidth Memory

Exploring memory synchronization and performance considerations for FPGA platform using the high-abstracted OpenCL framework: Benchmarks development and analysis

Aggressive Pipelining of Irregular Applications on Reconfigurable Hardware

Software Pipelining for Graphic Processing Unit Acceleration: Partition, Scheduling and Granularity