Abstract:Today's cloud platforms offer large virtual machine (VM) instances with multiple virtual CPUs (vCPU) on manycore machines. These machines typically have a deep memory hierarchy to enhance communication between cores. Although previous researches have primarily focused on addressing the performance scalability issues caused by the double scheduling problem in virtualized environments, they mainly concentrated on solving the preemption problem of synchronization primitives and the traditional NUMA architecture. This paper specifically targets a new aspect of scalability issues caused by the absence of runtime hypervisor-internal states (RHS). We demonstrate two typical RHS problems, namely the invisible pCPU (physical CPU) load and dynamic cache group mapping. These RHS problems result in a collapse in VM performance and low CPU utilization because the guest VM lacks visibility into the latest runtime internal states maintained by the hypervisor, such as pCPU load and vCPU-pCPU mappings. Consequently, the guest VM makes inefficient scheduling decisions. To address the RHS issue, we argue that the solution lies in exposing the latest scheduling decisions made by both the guest and host schedulers to each other. Hence, we present a cooperative para-virtualized scheduling framework called CPS, which facilitates the proactive exchange of timely scheduling information between the hypervisor and guest VMs. To ensure effective scheduling decisions for VMs, a series of techniques are proposed based on the exchanged information. We have implemented CPS in Linux KVM and have designed corresponding solutions to tackle the two RHS problems. Evaluation results demonstrate that CPS significantly improves the performance of PARSEC by 81.1% and FxMark by 1.01x on average for the two identified problems.

Multicore-aware application parallel scheduling platform

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Efficient Consolidation-Aware VCPU Scheduling on Multicore Virtualization Platform.

Hybrid CPU Management for Adapting to the Diversity of Virtual Machines

Affinity and Conflict-Aware Placement of Virtual Machines in Heterogeneous Data Centers.

Research on Parallel Task Scheduling Algorithm of SaaS Platform Based on Dynamic Adaptive Particle Swarm Optimization in Cloud Service Environment

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Virtualization-based autonomic resource management for multi-tier Web applications in shared data center

Runtime model based approach to using hybrid PaaS services.

Multi-Cluster Co-Allocation Scheduling Algorithms in Virtual Computing Environment

The hybrid scheduling framework for virtual machine systems

Multiple Virtual Machines Resource Scheduling for Cloud Computing

CPS: A Cooperative Para-virtualized Scheduling Framework for Manycore Machines

5. . “Runtime Model based Approach to Using Hybird PaaS Service.” , EI

Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center

A Power-aware Scheduling Algorithm in Multi-tenant IaaS Clouds

A Scheduler System for Large-Scale Distributed Data Computing in Cloud

Power-aware I/O-Intensive and CPU-Intensive applications hybrid deployment within virtualization environments

An Availability-Aware Virtual Machine Placement Approach for Dynamic Scaling of Cloud Applications

Improving the QoS of Web Applications Across Multiple Virtual Machines in Cloud Computing Environment