Abstract:In recent years, heterogeneous computing has emerged as the vital way to increase computers? performance and energy efficiency by combining diverse hardware devices, such as Graphics Processing Units (GPUs) and Field Programmable Gate Arrays (FPGAs). The rationale behind this trend is that different parts of an application can be offloaded from the main CPU to diverse devices, which can efficiently execute these parts as co-processors. FPGAs are a subset of the most widely used co-processors, typically used for accelerating specific workloads due to their flexible hardware and energy-efficient characteristics. These characteristics have made them prevalent in a broad spectrum of computing systems ranging from low-power embedded systems to high-end data centers and cloud infrastructures. However, these hardware characteristics come at the cost of programmability. Developers who create their applications using high-level programming languages (e.g., Java, Python, etc.) are required to familiarize with a hardware description language (e.g., VHDL, Verilog) or recently heterogeneous programming models (e.g., OpenCL, HLS) in order to exploit the co-processors? capacity and tune the performance of their applications. Currently, the above-mentioned heterogeneous programming models support exclusively the compilation from compiled languages, such as C and C++. Thus, the transparent integration of heterogeneous co-processors to the software ecosystem of managed programming languages (e.g. Java, Python) is not seamless. In this paper we rethink the engineering trade-offs that we encountered, in terms of transparency and compilation overheads, while integrating FPGAs into high-level managed programming languages. We present a novel approach that enables runtime code specialization techniques for seamless and high-performance execution of Java programs on FPGAs. The proposed solution is prototyped in the context of the Java programming language and TornadoVM; an open-source programming framework for Java execution on heterogeneous hardware. Finally, we evaluate the proposed solution for FPGA execution against both sequential and multi-threaded Java implementations showcasing up to 224x and 19.8x performance speedups, respectively, and up to 13.82x compared to TornadoVM running on an Intel integrated GPU. We also provide a break-down analysis of the proposed compiler optimizations for FPGA execution, as a means to project their impact on the applications? characteristics.

High Level Programming for Heterogeneous Architectures

From opencl to high-performance hardware on FPGAS

Extending High-Level Synthesis for Task-Parallel Programs

OpenH: A Novel Programming Model and API for Developing Portable Parallel Programs on Heterogeneous Hybrid Servers

An OpenCL Framework for Distributed Apps on a Multidimensional Network of FPGAs

A Performance Analysis Framework For Optimizing Opencl Applications On Fpgas

Transparent Compiler and Runtime Specializations for Accelerating Managed Languages on FPGAs

Challenging Portability Paradigms: FPGA Acceleration Using SYCL and OpenCL

High-Level Programming of FPGA-Accelerated Systems with Parallel Patterns

Fortran High-Level Synthesis: Reducing the barriers to accelerating HPC codes on FPGAs

Enabling FPGAs for the Masses

Towards Automatic Transformation of Legacy Scientific Code into OpenCL for Optimal Performance on FPGAs

FLIA: Architecture of Collaborated Mobile GPU and FPGA Heterogeneous Computing

GAHLS: an optimized graph analytics based high level synthesis framework

TAPA-CS: Enabling Scalable Accelerator Design on Distributed HBM-FPGAs

HeteroFlow: An Accelerator Programming Model with Decoupled Data Placement for Software-Defined FPGAs

Accelerating the computation of FLAPW methods on heterogeneous architectures

Resource-Aware Just-in-Time OpenCL Compiler for Coarse-Grained FPGA Overlays

Executing Dynamic Data Rate Actor Networks on OpenCL Platforms

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

Multilevel Granularity Parallelism Synthesis on FPGAs