Abstract:With the rapid increase of data set size of cloud and big data applications, conventional regular 4KB pages can cause high pressure on hardware address translations. The pressure becomes more prominent in a virtualized system, which adds an additional layer of address translation. Virtual to physical address translations reply on a hardware Translation Lookaside Buffer (TLB) to cache address mappings. However, even modern hardware offers a very limited number of TLB entries. Meanwhile, TLB misses can cause significant performance degradation. Using 2MB or 1GB hugepages can improve TLB coverage and reduce TLB miss penalty. Therefore, recent operation systems, such as Linux, start to adopt hugepages. However, using hugepages bring new challenges, among which is working set size prediciton. In a virtualized system, working set size (WSS) estimation, which predicts the actual memory demand of a virtual machine, is often applied to guide virtual machine memory management and memory allocation. We find that traditional WSS estimation methods with regular pages cannot be simply ported to a system adopting hugepages. We estimate the working set size of a virtual machine by constructing a miss ratio curve (MRC), which relates page miss ratio to the virtual machine memory allocation. Using hugepages increases the overhead to track page accesses for MRC construction and also demands much higher precision in representing the miss ratios as a hugepage miss leads to a much higher penalty than a regular page miss. In this paper, we propose an accurate WSS estimation method in a virtual execution environment with hugepages. We design and implement a low-overhead dynamic memory tracking mechanism by utilizing a hot set to filter frequent short-reuse accesses. Our approach is able to output a hugepage miss ratio at high precision. The experimental results show that our method can predict WSS accurately with an average overhead of 1.5%.

The Work Function Algorithm for the Paging Problem

A New Upper Bound on the Work Function Algorithm for the K-Server Problem.

MFLWQ: a fair and adaptive queue management algorithm for scavenger service

A simple semi on-line algorithm for

Paging with dynamic memory capacity

On the Additive Constant of the k-server Work Function Algorithm

Enhanced Wfq Algorithm With (M,K)-Firm Guarantee

A Weighted Fair Queuing Scheduling Algorithm With (M,K)-Firm Guarantee

Online Paging with Heterogeneous Cache Slots

Workload-Aware Scheduling for Data Analytics upon Heterogeneous Storage

Competitive Analysis of Online Machine Rental and Online Parallel Machine Scheduling Problems with Workload Fence.

On the design of scheduling algorithms for end-to-end backlog minimization in multi-hop wireless networks

An Efficient File Assignment Strategy for Hybrid Parallel Storage System with Energy & Reliability Constraints

A Decomposition Based Algorithm for the Scheduling Problem in Wafer Fabrication System

Enhancing Fairness for Approximate Weighted Fair Queueing with a Single Queue

Working Set Size Estimation with Hugepages in Virtualization.

An Effective Water Wave Optimization Algorithm with Problem-Specific Knowledge for the Distributed Assembly Blocking Flow-Shop Scheduling Problem

A Deterministic Parallel Scheduling Algorithm for Input Queued Crossbar Switches

Randomized Parallel Scheduling Algorithm for Input Queued Crossbar Switches.

Energy Aware Task Scheduling in Data Centers.