Abstract:Today extending virtualization technology into high-performance, cluster platforms generates exciting new possibilities, including dynamic allocation of resources to job, easier to share resources between different jobs, easy checkpointing of jobs, and deployment of job-specific work environment. However, there still exists an I/O scalability problem in virtualization layer which may impede virtualization technology to be widely used in high-performance computing. Because we meet a sharp performance degradation when a virtual machine uses the multiqueue high performance non-volatile storage device as the secondary storage. Such a problem is caused by the current virtual block I/O layer which uses only one I/O thread to handle all I/O operations to a virtualized storage device. As the number of I/O intensive workloads increases, the rate of mutex contention of the I/O thread is accelerated because only one of them is allowed to run at any given instant. Therefore, it is the key problem that should be settled immediately so as to improve block I/O performance in virtualization. In this paper, we propose a novel design of high performance block I/O stack to solve this problem. The workloads will be free of the I/O contention inside the hypervisor by using the proposed method which uses multi-threaded I/O threads to handle all I/O operations to one storage device in parallel. Meanwhile, we use switch-less mechanisms to reduce the overhead caused by sending notification between a VM and its hypervisor; and improve I/O affinity by assigning a distinct dedicated core to each I/O thread in order to eliminate unnecessary scheduling. The prototype system is implemented on Linux 3.19 kernel and Quick Emulator (QEMU) 2.3.1. We deploy it to the POWER8 server for a detailed evaluation. The experimental results show that the proposed architecture scales graciously with multi-core environment. For example, test on 10-ways parallel I/O intensive workloads gets an 800\% increase than the single core implementation, indicating that the block I/O performance in a virtual machine is close to that of a bare metal system.

vPFS+: Managing I/O Performance for Diverse HPC Applications

Black-hole threshold solutions in stiff fluid collapse

Performance-Aware Data Placement in Hybrid Parallel File Systems.

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

Boosting Parallel File System Performance Via Heterogeneity-Aware Selective Data Layout.

A Migratory Heterogeneity-Aware Data Layout Scheme for Parallel File Systems.

PSA: A Performance and Space-Aware Data Layout Scheme for Hybrid Parallel File Systems

HAS: Heterogeneity-Aware Selective Data Layout Scheme for Parallel File Systems on Hybrid Servers

A Heterogeneity-Aware Region-Level Data Layout for Hybrid Parallel File Systems.

HARL: Optimizing Parallel File Systems with Heterogeneity-Aware Region-Level Data Layout

Fine-grained Policy-driven I/O Sharing for Burst Buffers

Enhancing Proportional IO Sharing on Containerized Big Data File Systems

High Performance and Scalable Virtual Machine Storage I/O Stack for Multicore Systems

HybridFS - A High Performance and Balanced File System Framework with Multiple Distributed File Systems

S4D-Cache: Smart Selective SSD Cache for Parallel I/O Systems

MiF: Mitigating the Intra-file Fragmentation in Parallel File System.

A Dynamic Extension and Data Migration Method Based on PVFS.

Vpifo: Virtualized Packet Scheduler for Programmable Hierarchical Scheduling in High-Speed Networks

A cost-aware region-level data placement scheme for hybrid parallel I/O systems

HadaFS: A File System Bridging the Local and Shared Burst Buffer for Exascale Supercomputers.

Improving Performance of Parallel I/O Systems Through Selective and Layout-Aware SSD Cache