Abstract:Graphics Processing Unit (GPU) provides acceleration services to many applications, such as AI, games, media transcoding, etc. Virtualization on GPU is an enabling technology which facilitates the hardware resource sharing among multiple virtual machines (VMs). Sharing a GPU not only brings pros such as high utilization but also introduces cons such as resource contention and performance degradation. Although the existing GPU scheduling policies have been to some extent optimized, there are still some deficiencies, such as inefficient GPU sharing among multiple VMs, and high overhead within VM switching. As a result, the performance of GPU virtualization is limited by the current design, which lacks fine-grained scheduling supports. In this paper, we propose the Fine-grained schEduLing of vIrtualized gPu rEsources (FELIPE) to fully utilize and efficiently share a physical GPU among multiple VMs. To this end, we achieve the FELIPE optimization by introducing fine-grained scheduling mechanisms for virtualized GPU resources in three aspects: 1) We design a mixed time/event-based scheduling policy to reduce the idle time within VM switching. 2) We create a seamless VM assignment process, which enables VMs to switch seamlessly by stages. 3) We develop a hybrid per-ring/VM scheduling strategy, which schedules workloads to different GPU engines to run simultaneously. Then we implement the FELIPE with Intel Graphics Virtualization Technology for shared vGPU technology (GVT-g). Finally, the experimental evaluations show that the performance of the first two scheduling policies can respectively achieve up to 21.5% and 19.7% improvement, and the last one can improve the performance from 57.9% to 98.5% compared with the native design for two virtual machines.

Vgasa: Adaptive Scheduling Algorithm of Virtualized GPU Resource in Cloud Gaming

VGRIS: Virtualized GPU Resource Isolation and Scheduling in Cloud Gaming

A Virtual Multi-Channel GPU Fair Scheduling Method for Virtual Machines.

A Cloud Gaming System Based on User-Level Virtualization and Its Resource Scheduling

Adaptive scheduling host system and scheduling method of GPU virtual resources in cloud game

Fairness-Efficiency Allocation of CPU-GPU Heterogeneous Resources

Gqos: A QoS-Oriented GPU Virtualization with Adaptive Capacity Sharing

Energy-Efficient SLA Guarantees for Virtualized GPU in Cloud Gaming.

Fine-Grained Scheduling in Cloud Gaming on Heterogeneous CPU-GPU Clusters.

GScheduler: Optimizing Resource Provision by Using GPU Usage Pattern Extraction in Cloud Environments

Automated Resource Sharing for Virtualized GPU with Self-Configuration

Scalable GPU Virtualization with Dynamic Sharing of Graphics Memory Space

An Economy-Oriented GPU Virtualization with Dynamic and Adaptive Oversubscription.

Cost-Efficient and Quality of Experience-aware Player Request Scheduling and Rendering Server Allocation for Edge Computing Assisted Multiplayer Cloud Gaming

A user mode CPU–GPU scheduling framework for hybrid workloads

Enabling Efficient Spatio-Temporal GPU Sharing for Network Function Virtualization

Placing Virtual Machines to Optimize Cloud Gaming Experience

A Novel GPU Resources Management and Scheduling System Based on Virtual Machines

An Energy-Efficient Task Scheduling Method for CPU-GPU Heterogeneous Cloud.

GPGPU Task Scheduling Technique for Reducing the Performance Deviation of Multiple GPGPU Tasks in RPC-Based GPU Virtualization Environments

Efficient Sharing and Fine-Grained Scheduling of Virtualized GPU Resources