Abstract:As virtualization becomes a key technique for supporting cloud computing, much effort has been made to reduce virtualization overhead, so a virtualized system can match its native performance. One major overhead is due to memory or page table virtualization. Conventional virtual machines rely on a shadow mechanism to manage page tables, where a shadow page table maintained by the VMM (Virtual Machine Monitor) maps virtual addresses to machine addresses while a guest maintains its own virtual to physical page table. This shadow mechanism will result in expensive VM exits whenever there is a page fault that requires synchronization between the two page tables. To avoid this cost, both Intel and AMD provide hardware assists, EPT (extended page table) and NPT (nested page table), to facilitate address translation. With the hardware assists, the MMU (Memory Management Unit) maintains an ordinary guest page table that translates virtual addresses to guest physical addresses. In addition, the extended page table as provided by EPT translates from guest physical addresses to host physical or machine addresses. NPT works in a similar style. With EPT or NPT, a guest page fault can be handled by the guest itself without triggering VM exits. However, the hardware assists do have their disadvantage compared to the conventional shadow mechanism -- the page walk yields more memory accesses and thus longer latency. Our experimental results show that neither hardware-assisted paging (HAP) nor shadow paging (SP) can be a definite winner. Despite the fact that in over half of the cases, there is no noticeable gap between the two mechanisms, an up to 34% performance gap exists for a few benchmarks. We propose a dynamic switching mechanism that monitors TLB misses and guest page faults on the fly, and dynam-ically switches between the two paging modes. Our experiments show that this new mechanism can match and, sometimes, even beat the better performance of HAP and SP.

FlexPointer

FlexPointer: Fast Address Translation Based on Range TLB and Tagged Pointers

Translation lookaside buffer design based on dynamic memory page merging

Zweilous: A Decoupled and Flexible Memory Management Framework.

Selective Hardware/software Memory Virtualization

Coalesced TLB to Exploit Diverse Contiguity of Memory Mapping.

MetaTableLite - an Efficient Metadata Management Scheme for Tagged-Pointer-Based Spatial Safety.

Translation look-aside buffer with consecutive page merging and recycling

Hzmem: New Huge Page Allocator with Main Memory Compression.

DangKiller: Eliminating Dangling Pointers Efficiently Via Implicit Identifier

Runtime Biased Pointer Reuse Analysis and Its Application to Energy Efficiency

Swift shadow paging (SSP): no write-protection but following TLB flushing

New run-time pointer aliasing disambiguation method

A Lightweight Hybrid Hardware/software Approach for Object-Relative Memory Profiling

Pointer: An Energy-Efficient ReRAM-based Point Cloud Recognition Accelerator with Inter-layer and Intra-layer Optimizations

TsmartGP: a tool for finding memory defects with pointer analysis

(No)Compromis: paging virtualization is not a fatality

Towards Eliminating Memory Virtualization Overhead

Fast and Low Power TLB Access Mechanism with Prediction Buffer

A Low-Power Dtlb Design Based on Memory Region Encoding

HFB: A page-block hybrid buffer manager for flash memory