Abstract:Efficient utilization of restrained memory resources is of paramount importance in CPU-FPGA heterogeneous multiprocessor system-on-chip (HMPSoC)-based system design for memory-intensive applications. State-of-the-art high level synthesis (HLS) tools rely on the system programmers to manually determine the data placement within the complex memory hierarchy. Different data placement policies may lead to different system performance, and finding an optimal data placement policy is a nontrivial problem. For instance, we show counter-intuitive results that traditional frequency and locality-based data placement strategy designed for CPU architecture leads to nonoptimal system performance in CPU-FPGA HMPSoCs. In this work, we first propose an automatic data placement framework for field programmable gate array (FPGA) kernels to determine whether each array object should be accessed via the on-chip BRAM, shared CPU L2-cache, or DDR memory to achieve the optimal performance. Moreover, we find that when the CPU kernel and the FPGA kernel are executed in parallel, memory contentions may degrade the performance and the optimal data placement policy designed for the FPGA kernel alone will not achieve the optimal overall system performance. In this article, we proposed to use cache partitioning to alleviate the impact brought by memory contentions. We extend the framework designed for FPGA by adding the cross-layer memory contentions analysis to automatically generate an optimal data placement policy and cache partitioning mechanism for the parallel executing kernels. The proposed data placement framework can be seamlessly integrated with the commercial Vivado HLS. The experimental results on the Zedboard platform show an average performance speedup for FPGA kernels compared with a greedy-based allocation strategy. When FPGA kernels and CPU kernels are executed in parallel, the FPGA kernel and- the CPU kernel have a performance speedup of and on average, respectively.

Effective File Data-Block Placement for Different Types of Page Cache on Hybrid Main Memory Architectures

LPCA: Learned MRC Profiling based Cache Allocation for File Storage Systems

A cost-aware region-level data placement scheme for hybrid parallel I/O systems

AMC: an Adaptive Multi‐level Cache Algorithm in Hybrid Storage Systems

DPA: Demand-Based Partition and Data Allocation for Hybrid On-Chip Memory

Adaptive Placement and Migration Policy for an STT-RAM-based Hybrid Cache

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

Improving In-Memory File System Reading Performance by Fine-Grained User-Space Cache Mechanisms

Performance-Aware Data Placement in Hybrid Parallel File Systems.

Stochastic Modeling of Hybrid Cache Systems

Low-Power Low-Latency Data Allocation for Hybrid Scratch-Pad Memory

A hybrid memory architecture supporting fine-grained data migration

Efficient page caching algorithm with prediction and migration for a hybrid main memory

Exploring DRAM Cache Prefetching for Pooled Memory

Efficient Memory Partitioning for Parallel Data Access in FPGA via Data Reuse

Improving Performance of Parallel I/O Systems Through Selective and Layout-Aware SSD Cache

HFB: A page-block hybrid buffer manager for flash memory

CARAM: A Content-Aware Hybrid PCM/DRAM Main Memory System Framework

Data layout optimization based on the spatio-temporal model of field access

Object-Level Memory Allocation and Migration in Hybrid Memory Systems

Global Data Access Optimization Via Load/Store Instruction Extension