Abstract:Efficient utilization of restrained memory resources is of paramount importance in CPU-FPGA heterogeneous multiprocessor system-on-chip (HMPSoC)-based system design for memory-intensive applications. State-of-the-art high level synthesis (HLS) tools rely on the system programmers to manually determine the data placement within the complex memory hierarchy. Different data placement policies may lead to different system performance, and finding an optimal data placement policy is a nontrivial problem. For instance, we show counter-intuitive results that traditional frequency and locality-based data placement strategy designed for CPU architecture leads to nonoptimal system performance in CPU-FPGA HMPSoCs. In this work, we first propose an automatic data placement framework for field programmable gate array (FPGA) kernels to determine whether each array object should be accessed via the on-chip BRAM, shared CPU L2-cache, or DDR memory to achieve the optimal performance. Moreover, we find that when the CPU kernel and the FPGA kernel are executed in parallel, memory contentions may degrade the performance and the optimal data placement policy designed for the FPGA kernel alone will not achieve the optimal overall system performance. In this article, we proposed to use cache partitioning to alleviate the impact brought by memory contentions. We extend the framework designed for FPGA by adding the cross-layer memory contentions analysis to automatically generate an optimal data placement policy and cache partitioning mechanism for the parallel executing kernels. The proposed data placement framework can be seamlessly integrated with the commercial Vivado HLS. The experimental results on the Zedboard platform show an average performance speedup for FPGA kernels compared with a greedy-based allocation strategy. When FPGA kernels and CPU kernels are executed in parallel, the FPGA kernel and- the CPU kernel have a performance speedup of and on average, respectively.

LAMA: Link-Aware Hybrid Management for Memory Accesses in Emerging CPU-FPGA Platforms

A Hybrid Approach to Cache Management in Heterogeneous CPU-FPGA Platforms.

CAMAS: Static and Dynamic Hybrid Cache Management for CPU-FPGA Platforms

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

Automatic Data Placement For Cpu-Fpga Heterogeneous Multiprocessor System-On-Chips

LLAMA: The Low-Level Abstraction For Memory Access

Augmenting HLS with Zero-Overhead Application-Specific Address Mapping for Optane DCPMM

PUMA: Pseudo unified memory architecture for single-ISA heterogeneous multi-core systems

Programmable FPGA-based Memory Controller

HyFarM: Task Orchestration on Hybrid Far Memory for High Performance Per Bit

LosaTM: A Hardware Transactional Memory Integrated with a Low-Overhead Scenario-Awareness Conflict Manager

The Masala Machine: Accelerating Thread-Intensive And Explicit Memory Management Programs With Dynamically Reconfigurable Fpgas

Hi-DMM: High-Performance Dynamic Memory Management in High-Level Synthesis.

Accelerating thread-intensive and explicit memory management programs with dynamic partial reconfiguration

Lazy Load Scheduling for Mixed-criticality Applications in Heterogeneous MPSoCs

Analyzing Memory Access on CPU-GPGPU Shared LLC Architecture

LlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAs

Compiling C-like Languages to FPGA Hardware: Some Novel Approaches Targeting Data Memory Organisation

A Memory Access Scheduling Method for Multi-core Processor

Lirac: Using Live Range Information To Optimize Memory Access

Asynchronous Memory Access Unit: Exploiting Massive Parallelism for Far Memory Access