Abstract:Quality of service (QoS) has evolved to ensure performance across various computing environments, focusing on data bandwidth, response time, throughput, and stability. Traditional QoS schemes primarily target DRAM-based homogeneous memory systems, exposing limitations when applied to diverse memory configurations. Moreover, the emergence of nonvolatile memories (NVMs) has made achieving QoS even more challenging due to their differing characteristics. While QoS schemes have been proposed for DRAM-based memory systems or hybrid memory systems combining DRAM and a single NVM type, there is a lack of research on QoS techniques for memory systems that incorporate multiple types of NVM simultaneously. Ensuring QoS in these heterogeneous memory environments is challenging due to significant differences in memory characteristics. In this paper, we propose a novel technique, dynamic affinity-based resource pairing (DARP), designed to enhance QoS in multicore heterogeneous memory systems. The proposed approach dynamically monitors the memory access patterns of applications and leverages the specific read/write characteristics of NVM devices. Detailed information from monitoring is used to optimally allocate memory data to the most suitable memory devices, ensuring stable memory response times and mitigating bottlenecks. Extensive experiments validate the efficiency and scalability of DARP across various workloads and heterogeneous memory configurations, including memory systems with multiple types of NVM. The results show that our technique significantly outperforms state-of-the-art QoS methods in terms of memory response time consistency and overall QoS in heterogeneous memory environments. DARP achieved a memory response time variability of 74.4% in six different memory configurations compared to the baseline on average, demonstrating its high scalability and effectiveness in enhancing QoS across various heterogeneous memory systems.

A QoS Management Mechanism of Memory Controller Based on Row Conflict Prediction

Efficiency-Aware QoS DRAM Scheduler

A Staged Memory Resource Management Method for CMP Systems

Improving System Performance in Heterogeneous MPSoC Systems via Dynamic DRAM Bandwidth Allocation

MCS-DMA: An optimization design of memory controller for DMA transfers in SoC

Parallelism-Aware Memory Interference Delay Analysis for COTS Multicore Systems

Memory Access Scheduling Based on Dynamic Multilevel Priority in Shared DRAM Systems

Enhancing QoS in Multicore Systems with Heterogeneous Memory Configurations

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

Agent-Based Memory Access for Many-Core CMPs

SLICE Matrix: A Memory Access Scheduling Policy for Multicore Network Processors

Combining PVT Simulation and Queuing Model for System-Level Performance Analysis of Main Memory System

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

Prediction Table Based Management Policy for STT-RAM and SRAM Hybrid Cache

Analysis of Interference between RDMA and Local Access on Hybrid Memory System

Priority Based Fair Scheduling : A Memory Scheduler Design for Chip-Multiprocessor Systems

Hardware Implementation of a High Performance and Low Power DDR2 Controller

Prefetch-directed Scheme for Accelerating Memory Accesses of PCIe-based I/O Subsystem

Migration-aware slot-based memory request scheduler to guarantee QoS in DRAM-PCM hybrid memories

Page Policy Control with Memory Partitioning for DRAM Performance and Power Efficiency

High-Performance and Energy-Effcient Memory Scheduler Design for Heterogeneous Systems