Abstract:Applications running concurrently in CMP systems interfere with each other at DRAM memory, leading to poor system performance and fairness. Memory access scheduling reorders memory requests to improve system throughput and fairness. However, it cannot resolve the interference issue effectively. To reduce interference, memory partitioning divides memory resource among threads. Memory channel partitioning maps the data of threads that are likely to severely interfere with each other to different channels. However, it allocates memory resource unfairly and physically exacerbates memory contention of intensive threads, thus ultimately resulting in the increased slowdown of these threads and high system unfairness. Bank partitioning divides memory banks among cores and eliminates interference. However, previous equal bank partitioning restricts the number of banks available to individual thread and reduces bank level parallelism. In this paper, we first propose a Dynamic Bank Partitioning (DBP), which partitions memory banks according to threads' requirements for bank amounts. DBP compensates for the reduced bank level parallelism caused by equal bank partitioning. The key principle is to profile threads' memory characteristics at run-time and estimate their demands for bank amount, then use the estimation to direct our bank partitioning. Second, we observe that bank partitioning and memory scheduling are orthogonal in the sense; both methods can be illuminated when they are applied together. Therefore, we present a comprehensive approach which integrates Dynamic Bank Partitioning and Thread Cluster Memory scheduling (DBP-TCM, TCM is one of the best memory scheduling) to further improve system performance. Experimental results show that the proposed DBP improves system performance by 4.3% and improves system fairness by 16% over equal bank partitioning. Compared to TCM, DBP-TCM improves system throughput by 6.2% and fairness by 16.7%. When compared with MCP, DBP-TCM p- ovides 5.3% better system throughput and 37% better system fairness. We conclude that our methods are effective in improving both system throughput and fairness.

A Staged Memory Resource Management Method for CMP Systems

Improving system throughput and fairness simultaneously in shared memory CMP systems via Dynamic Bank Partitioning

Improving System Performance in Heterogeneous MPSoC Systems via Dynamic DRAM Bandwidth Allocation

A Memory Access Scheduling Method for Multi-core Processor

Enhancing the Performance and Fairness of Shared DRAM Systems with Sharing-Aware Scheduling

Memory Access Scheduling Based on Dynamic Multilevel Priority in Shared DRAM Systems

A Performance Conserving Approach for Reducing Memory Power Consumption in Multi-Core Systems

Page Policy Control with Memory Partitioning for DRAM Performance and Power Efficiency

High-Performance and Energy-Effcient Memory Scheduler Design for Heterogeneous Systems

Coordinate Channel-Aware Page Mapping Policy and Memory Scheduling for Reducing Memory Interference among Multimedia Applications.

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

Optimizing Scheduling in Embedded CMP Systems with Phase Change Memory

Characterizing and Optimizing Hybrid DRAM-PM Main Memory System with Application Awareness

PMR: Priority Memory Reclaim to Improve the Performance of Latency-Critical Services

Cache/Memory Coordinated Fair Scheduling for Hybrid Memory Systems

Combine thread with memory scheduling for maximizing performance in multi-core systems

Bank Partitioning Based Adaptive Page Policy in Multi-core Memory Systems

Efficient Buffer Management For Pcm-Enhanced Hybrid Memory Architecture

Priority Based Fair Scheduling : A Memory Scheduler Design for Chip-Multiprocessor Systems

A Semi-automatic Scratchpad Memory Management Framework for CMP.

Toward Multi-Programmed Workloads with Different Memory Footprints: a Self-Adaptive Last Level Cache Scheduling Scheme