Abstract:Efficient utilization of restrained memory resources is of paramount importance in CPU-FPGA heterogeneous multiprocessor system-on-chip (HMPSoC)-based system design for memory-intensive applications. State-of-the-art high level synthesis (HLS) tools rely on the system programmers to manually determine the data placement within the complex memory hierarchy. Different data placement policies may lead to different system performance, and finding an optimal data placement policy is a nontrivial problem. For instance, we show counter-intuitive results that traditional frequency and locality-based data placement strategy designed for CPU architecture leads to nonoptimal system performance in CPU-FPGA HMPSoCs. In this work, we first propose an automatic data placement framework for field programmable gate array (FPGA) kernels to determine whether each array object should be accessed via the on-chip BRAM, shared CPU L2-cache, or DDR memory to achieve the optimal performance. Moreover, we find that when the CPU kernel and the FPGA kernel are executed in parallel, memory contentions may degrade the performance and the optimal data placement policy designed for the FPGA kernel alone will not achieve the optimal overall system performance. In this article, we proposed to use cache partitioning to alleviate the impact brought by memory contentions. We extend the framework designed for FPGA by adding the cross-layer memory contentions analysis to automatically generate an optimal data placement policy and cache partitioning mechanism for the parallel executing kernels. The proposed data placement framework can be seamlessly integrated with the commercial Vivado HLS. The experimental results on the Zedboard platform show an average performance speedup for FPGA kernels compared with a greedy-based allocation strategy. When FPGA kernels and CPU kernels are executed in parallel, the FPGA kernel and- the CPU kernel have a performance speedup of and on average, respectively.

Improved Procedure Placement for Set Associative Caches

CIACP: A Correlation- and Iteration- Aware Cache Partitioning Mechanism to Improve Performance of Multiple Coarse-Grained Reconfigurable Arrays.

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

HBPB, Applying Reuse Distance to Improve Cache Efficiency Proactively

Cache Miss Reduction Through Hardware-Assisted Loop Optimization

Lookahead Cache with Instruction Processing Unit for Filling Memory Gap

Effective Cache Apportioning for Performance Isolation Under Compiler Guidance

Enhanced Adaptive Insertion Policy for Shared Caches.

IPULOC - Exploring Dynamic Program Locality with the Instruction Processing Unit for Filling Memory Gap.

Optimizing Software Cache Performance of Packet Processing Applications

Instruction Cache Locking Using Temporal Reuse Profile

BTIP: Branch Triggered Instruction Prefetcher Ensuring Timeliness

A Technique to Exploit Memory Locality for Fast Instruction Set Simulation

Combining Process-Based Cache Partitioning and Pollute Region Isolation to Improve Shared Last Level Cache Utilization on Multicore Systems

Efficient Memory Partitioning For Parallel Data Access Via Data Reuse

Locality-aware Bank Partitioning for Shared DRAM MPSoCs.

Instruction Block Movement with Coupled High-Level Program Sequencing

Cache Hierarchy Optimization

Analysis and Performance Study for Coordinated Hierarchical Cache Placement Strategies

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs