Abstract:Efficient utilization of restrained memory resources is of paramount importance in CPU-FPGA heterogeneous multiprocessor system-on-chip (HMPSoC)-based system design for memory-intensive applications. State-of-the-art high level synthesis (HLS) tools rely on the system programmers to manually determine the data placement within the complex memory hierarchy. Different data placement policies may lead to different system performance, and finding an optimal data placement policy is a nontrivial problem. For instance, we show counter-intuitive results that traditional frequency and locality-based data placement strategy designed for CPU architecture leads to nonoptimal system performance in CPU-FPGA HMPSoCs. In this work, we first propose an automatic data placement framework for field programmable gate array (FPGA) kernels to determine whether each array object should be accessed via the on-chip BRAM, shared CPU L2-cache, or DDR memory to achieve the optimal performance. Moreover, we find that when the CPU kernel and the FPGA kernel are executed in parallel, memory contentions may degrade the performance and the optimal data placement policy designed for the FPGA kernel alone will not achieve the optimal overall system performance. In this article, we proposed to use cache partitioning to alleviate the impact brought by memory contentions. We extend the framework designed for FPGA by adding the cross-layer memory contentions analysis to automatically generate an optimal data placement policy and cache partitioning mechanism for the parallel executing kernels. The proposed data placement framework can be seamlessly integrated with the commercial Vivado HLS. The experimental results on the Zedboard platform show an average performance speedup for FPGA kernels compared with a greedy-based allocation strategy. When FPGA kernels and CPU kernels are executed in parallel, the FPGA kernel and- the CPU kernel have a performance speedup of and on average, respectively.

Multi-Bank Memory Aware Force Directed Scheduling for High-Level Synthesis.

Joint Modulo Scheduling And Memory Partitioning With Multi-Bank Memory For High-Level Synthesis

Memory fartitioning-based modulo scheduling for high-level synthesis.

Loop Scheduling and Bank Type Assignment for Heterogeneous Multi-Bank Memory.

Memory Partitioning and Scheduling Co-Optimization in Behavioral Synthesis

Power Aware Variable Partitioning and Instruction Scheduling for Multiple Memory Banks

A Pure Hardware-Driven Scheduler for Enhancing Bank-Level Parallelism in a Persistent Memory Controller

Memory partitioning for multidimensional arrays in high-level synthesis

Automatic multi-dimensional pipelining for high-level synthesis of dataflow accelerators

Automatic multidimensional memory partitioning for FPGA-based accelerators (abstract only).

Loop scheduling and assignment to minimize energy while hiding latency for heterogeneous multi-bank memory

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

A Memory Access Scheduling Method for Multi-core Processor

Efficient Memory Partitioning for Parallel Data Access in FPGA via Data Reuse

Pipeline-Based Partition Exploration for Heterogeneous Multiprocessor Synthesis.

Software Programmable Data Allocation in Multi-bank Memory of SIMD Processors.

High Performance Memory Management for a Multi-core Architecture.

Efficient Task Assignment And Scheduling For Mpsoc Dsps With Vs-Spm Considering Concurrent Accesses Through Data Allocation

Automatic Data Placement For Cpu-Fpga Heterogeneous Multiprocessor System-On-Chips

A gradual scheduling framework for problem size reduction and cross basic block parallelism exploitation in high-level synthesis

Address assignment sensitive variable partitioning and scheduling for DSPS with multiple memory banks