Abstract:Efficient utilization of restrained memory resources is of paramount importance in CPU-FPGA heterogeneous multiprocessor system-on-chip (HMPSoC)-based system design for memory-intensive applications. State-of-the-art high level synthesis (HLS) tools rely on the system programmers to manually determine the data placement within the complex memory hierarchy. Different data placement policies may lead to different system performance, and finding an optimal data placement policy is a nontrivial problem. For instance, we show counter-intuitive results that traditional frequency and locality-based data placement strategy designed for CPU architecture leads to nonoptimal system performance in CPU-FPGA HMPSoCs. In this work, we first propose an automatic data placement framework for field programmable gate array (FPGA) kernels to determine whether each array object should be accessed via the on-chip BRAM, shared CPU L2-cache, or DDR memory to achieve the optimal performance. Moreover, we find that when the CPU kernel and the FPGA kernel are executed in parallel, memory contentions may degrade the performance and the optimal data placement policy designed for the FPGA kernel alone will not achieve the optimal overall system performance. In this article, we proposed to use cache partitioning to alleviate the impact brought by memory contentions. We extend the framework designed for FPGA by adding the cross-layer memory contentions analysis to automatically generate an optimal data placement policy and cache partitioning mechanism for the parallel executing kernels. The proposed data placement framework can be seamlessly integrated with the commercial Vivado HLS. The experimental results on the Zedboard platform show an average performance speedup for FPGA kernels compared with a greedy-based allocation strategy. When FPGA kernels and CPU kernels are executed in parallel, the FPGA kernel and- the CPU kernel have a performance speedup of and on average, respectively.

An OpenCL-based Software Framework for a Heterogeneous Multicore Architecture on Zynq-7000 SoC

Parallelizing Workload Execution in Embedded and High-Performance Heterogeneous Systems

OpenCL + OpenSHMEM Hybrid Programming Model for the Adapteva Epiphany Architecture

A Scalable Hybrid Architecture for High Performance Data-Parallel Applications

Novel many-core architecture design for real-time image processing

An OpenCL Framework for Distributed Apps on a Multidimensional Network of FPGAs

OpenCL: A Parallel Programming Standard for Heterogeneous Computing Systems

High Level Programming for Heterogeneous Architectures

High-Performance Simultaneous Multiprocessing for Heterogeneous System-on-Chip

SOFF: An OpenCL High-Level Synthesis Framework for FPGAs

Programming Bare-Metal Accelerators with Heterogeneous Threading Models: A Case Study of Matrix-3000

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

Resource-Aware Just-in-Time OpenCL Compiler for Coarse-Grained FPGA Overlays

An Open-Source Platform for High-Performance Non-Coherent On-Chip Communication

Simulink®-based Heterogeneous Multiprocessor SoC Design Flow for Mixed Hardware/software Refinement and Simulation

Coarse-Grain Performance Estimator for Heterogeneous Parallel Computing Architectures like Zynq All-Programmable SoC

A framework to automatically generate heterogeneous organization reconfigurable multiprocessing

The Zynq-7000 SoC on UltraScale Architecture

From opencl to high-performance hardware on FPGAS

An Analysis Framework for Hardware and Software Implementations with Applications from Cryptography