Abstract:Today extending virtualization technology into high-performance, cluster platforms generates exciting new possibilities, including dynamic allocation of resources to job, easier to share resources between different jobs, easy checkpointing of jobs, and deployment of job-specific work environment. However, there still exists an I/O scalability problem in virtualization layer which may impede virtualization technology to be widely used in high-performance computing. Because we meet a sharp performance degradation when a virtual machine uses the multiqueue high performance non-volatile storage device as the secondary storage. Such a problem is caused by the current virtual block I/O layer which uses only one I/O thread to handle all I/O operations to a virtualized storage device. As the number of I/O intensive workloads increases, the rate of mutex contention of the I/O thread is accelerated because only one of them is allowed to run at any given instant. Therefore, it is the key problem that should be settled immediately so as to improve block I/O performance in virtualization. In this paper, we propose a novel design of high performance block I/O stack to solve this problem. The workloads will be free of the I/O contention inside the hypervisor by using the proposed method which uses multi-threaded I/O threads to handle all I/O operations to one storage device in parallel. Meanwhile, we use switch-less mechanisms to reduce the overhead caused by sending notification between a VM and its hypervisor; and improve I/O affinity by assigning a distinct dedicated core to each I/O thread in order to eliminate unnecessary scheduling. The prototype system is implemented on Linux 3.19 kernel and Quick Emulator (QEMU) 2.3.1. We deploy it to the POWER8 server for a detailed evaluation. The experimental results show that the proposed architecture scales graciously with multi-core environment. For example, test on 10-ways parallel I/O intensive workloads gets an 800\% increase than the single core implementation, indicating that the block I/O performance in a virtual machine is close to that of a bare metal system.

Construction And Performance Analysis Of Unified Storage Cloud Platform Based On Openstack With Ceph Rbd

A New Approach to Double I/O Performance for Ceph Distributed File System in Cloud Computing

Understanding the Performance of Ceph Block Storage for Hyper-Converged Cloud with All Flash Storage

A Behind-the-Scenes Story on Applying Cross-Layer Coordination to Disks and RAIDs

Performance Analysis and Framework Optimization of Open Source Cloud Storage System

On The Implementation Of Brs Codes In Ceph

An adaptive read/write optimized algorithm for Ceph heterogeneous systems via performance prediction and multi-attribute decision making

Analysis of Big Data Platform with OpenStack and Hadoop.

A Practical Cross-Datacenter Fault-Tolerance Algorithm in the Cloud Storage System.

BM-Store: A Transparent and High-performance Local Storage Architecture for Bare-metal Clouds Enabling Large-scale Deployment

S3R5: A Snapshot Storage System Based on ROW with Rapid Rollback, Recovery and Read-Write

Implementation and Performance Evaluation of an Object-Based Storage Device

High Performance and Scalable Virtual Machine Storage I/O Stack for Multicore Systems

A distributed storage method of remote sensing data based on image blocks organization

Research of Enterprise Private Cloud Computing Platform Based on Openstack

Leveraging OpenStack and Ceph for a Controlled-Access Data Cloud

IOArbiter: Dynamic Provisioning of Backend Block Storage in the Cloud

When Cloud Storage Meets RDMA.

Efficient Support of Big Data Storage Systems on the Cloud

International Network Performance and Security Testing Based on Distributed Abyss Storage Cluster and Draft of Data Lake Framework

Design and Implementation of an Asymmetric Block-Based Parallel File System