Abstract:Emerging three-dimensional (3D) memory technologies, such as the Hybrid Memory Cube (HMC) and High Bandwidth Memory (HBM), provide high-bandwidth and massive memory-level parallelism. With the growing heterogeneity and complexity of computer systems (CPU cores and accelerators, etc.), efficiently integrating emerging memories into existing systems poses new challenges and requires detailed evaluation in a realistic computing environment. In this article, we propose MEG, an open source, configurable, cycle-exact, and RISC-V-based full-system emulation infrastructure using FPGA and HBM. MEG provides a highly modular hardware design and includes a bootable Linux image for a realistic software flow, so that users can perform cross-layer software-hardware co-optimization in a full-system environment. To improve the observability and debuggability of the system, MEG also provides a flexible performance monitoring scheme to guide the performance optimization. The proposed MEG infrastructure can potentially benefit broad communities across computer architecture, system software, and application software. Leveraging MEG, we present two cross-layer system optimizations as illustrative cases to demonstrate the usability of MEG. In the first case study, we present a reconfigurable memory controller to improve the address mapping of standard memory controller. This reconfigurable memory controller along with its OS support allows us to optimize the address mapping scheme to fully exploit the massive parallelism provided by the emerging three-dimensional (3D) memories. In the second case study, we present a lightweight IOMMU design to tackle the unique challenges brought by 3D memory in providing virtual memory support for near-memory accelerators. We provide a prototype implementation of MEG on a Xilinx VU37P FPGA and demonstrate its capability, fidelity, and flexibility on real-world benchmark applications. We hope MEG fills a gap in the space of publicly available FPGA-based full-system emulation infrastructures, specifically targeting memory systems, and inspires further collaborative software/hardware innovations.

Simulation Environment with Customized RISC-V Instructions for Logic-in-Memory Architectures

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

RISC-Vlim, a RISC-V Framework for Logic-in-Memory Architectures

MEG: A RISCV-Based System Simulation Infrastructure for Exploring Memory Optimization Using FPGAs and Hybrid Memory Cube

Custom Memory Design for Logic-in-Memory: Drawbacks and Improvements over Conventional Memories

An Extensible Memory Simulation Framework for Chip Multi-Processors

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

MEG: A RISCV-based System Emulation Infrastructure for Near-data Processing Using FPGAs and High-bandwidth Memory

Functional Demonstration of a Memristive Arithmetic Logic Unit (memalu) for In‐Memory Computing

High-Quality Iterative Logic Compiler for In-Memory SIMD Computation with Tight Coupling of Synthesis and Scheduling

A Novel Computing-in-Memory Platform Based on Hybrid Spintronic/CMOS Memory

Adding Explicit Load-Acquire and Store-Release Instructions to the RISC-V ISA

Reprogrammable Logic in Memristive Crossbar for In-Memory Computing

A Programmable Logic-in-Memory Architecture Based on 22nm Fully DepletedSilicon on Insulator Technology.

Full-stack evaluation of Machine Learning inference workloads for RISC-V systems

An Approach to Build Cycle Accurate Full System VLIW Simulation Platform.

OCC: An Automated End-to-End Machine Learning Optimizing Compiler for Computing-In-Memory

Enabling in-situ logic-in-memory capability using resistive-RAM crossbar memory

Memristive Combinational And Sequential Logic For In-Memory Computing

PIM-AI: A Novel Architecture for High-Efficiency LLM Inference

Scalable and RISC-V Programmable Near-Memory Computing Architectures for Edge Nodes