Abstract:Emerging three-dimensional (3D) memory technologies, such as the Hybrid Memory Cube (HMC) and High Bandwidth Memory (HBM), provide high-bandwidth and massive memory-level parallelism. With the growing heterogeneity and complexity of computer systems (CPU cores and accelerators, etc.), efficiently integrating emerging memories into existing systems poses new challenges and requires detailed evaluation in a realistic computing environment. In this article, we propose MEG, an open source, configurable, cycle-exact, and RISC-V-based full-system emulation infrastructure using FPGA and HBM. MEG provides a highly modular hardware design and includes a bootable Linux image for a realistic software flow, so that users can perform cross-layer software-hardware co-optimization in a full-system environment. To improve the observability and debuggability of the system, MEG also provides a flexible performance monitoring scheme to guide the performance optimization. The proposed MEG infrastructure can potentially benefit broad communities across computer architecture, system software, and application software. Leveraging MEG, we present two cross-layer system optimizations as illustrative cases to demonstrate the usability of MEG. In the first case study, we present a reconfigurable memory controller to improve the address mapping of standard memory controller. This reconfigurable memory controller along with its OS support allows us to optimize the address mapping scheme to fully exploit the massive parallelism provided by the emerging three-dimensional (3D) memories. In the second case study, we present a lightweight IOMMU design to tackle the unique challenges brought by 3D memory in providing virtual memory support for near-memory accelerators. We provide a prototype implementation of MEG on a Xilinx VU37P FPGA and demonstrate its capability, fidelity, and flexibility on real-world benchmark applications. We hope MEG fills a gap in the space of publicly available FPGA-based full-system emulation infrastructures, specifically targeting memory systems, and inspires further collaborative software/hardware innovations.

MEGATRON: Software-Managed Device TLB for Shared-Memory FPGA Virtualization

A Hypervisor for Shared-Memory FPGA Platforms

MEG: A RISCV-based System Emulation Infrastructure for Near-data Processing Using FPGAs and High-bandwidth Memory

MEG: A RISCV-Based System Simulation Infrastructure for Exploring Memory Optimization Using FPGAs and Hybrid Memory Cube

FPGA based hardware-software co-designed dynamic binary translation system

Selective Hardware/software Memory Virtualization

METICULOUS: An FPGA-based Main Memory Emulator for System Software Studies

Accelerating Address Translation for Virtualization by Leveraging Hardware Mode

Architectural support for sharing, isolating and virtualizing FPGA resources.

Hardware-Software Collaborative Tiered-Memory Management Framework for Virtualization

Enabling Large-Reach TLBs for High-Throughput Processors by Exploiting Memory Subregion Contiguity

Near-Memory Address Translation

Programmable FPGA-based Memory Controller

Efficient Virtual Memory Sharing via On-Accelerator Page Table Walking in Heterogeneous Embedded SoCs

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

Breaking the Synchronization Bottleneck with Reconfigurable Transactional Execution

FPGA-based Hyrbid Memory Emulation System

Accelerating thread-intensive and explicit memory management programs with dynamic partial reconfiguration

Hardware Memory Management for Future Mobile Hybrid Memory Systems

NeoMem: Hardware/Software Co-Design for CXL-Native Memory Tiering

Ultra-Low-Latency and Flexible In-memory Key-Value Store System Design on CPU-FPGA