Abstract:As user-generated data diversifies, an increasing number of big data tasks now encompass unstructured data forms, including audio, imagery, and video content. The processing of these data often requires the support of GPU devices in the cluster. However, most of the existing cluster resource management frameworks lack effective decoupling of CPU resources and GPU resources, and the management granularity of GPU resources is too coarse, resulting in poor GPU sharing and low resource utilization. Given, for the inadequacy of the existing cluster resource management framework that cannot support batch stream integration and CPU-GPU resource scheduling, we design and implement a Hybrid Heterogeneous Resource Management (H-HRM) for CPU-GPU heterogeneous clusters. The resource queue binding mechanism on computing nodes provides flexible binding of CPU resources to GPU resources, which solves the problem that CPU resources and GPU resources in the cluster are difficult to decouple. According to the different uses of CPU or GPU as the main resource, a Hybrid Domain Resource Fairness (HDRF) model is proposed to realize the reasonable allocation of CPU resources and GPU resources. Through the queue stacking technology and the mechanism that multiple executors can run simultaneously on the queue, fine-grained sharing of GPU resources is realized and the utilization rate of GPU resources is improved. Finally, this paper realizes the docking of H-HRM and Spark programming framework and conducts real load tests, and after comparing with the performance of Mesos, it is proved that H-HRM can handle the mixed scenarios of batch jobs and stream processing jobs in the cluster, and the HDRF algorithm also greatly improves the utilization of the GPU.

Adaptive scheduling host system and scheduling method of GPU virtual resources in cloud game

A Game-Theoretic Method of Fair Resource Allocation for Cloud Computing Services

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

A Virtual Multi-Channel GPU Fair Scheduling Method for Virtual Machines.

A Cloud Gaming System Based on User-Level Virtualization and Its Resource Scheduling

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

A user mode CPU–GPU scheduling framework for hybrid workloads

GPU Scheduling for Short Tasks in Private Cloud

Task Scheduling Greedy Heuristics for GPU Heterogeneous Cluster Involving the Weights of the Processor

A Real-time Virtual Reality Adaptive Streaming System

Design and realization of hybrid resource management system for heterogeneous cluster

Survey of GPU Virtualization

Task Scheduling for GPU Heterogeneous Cluster.

A Scheduler System for Large-Scale Distributed Data Computing in Cloud

A Self-Adaptive Workload Balancing Algorithm on Gpu Clusters

Research on Parallel Task Scheduling Algorithm of SaaS Platform Based on Dynamic Adaptive Particle Swarm Optimization in Cloud Service Environment

Dynamic system allocation and application of cloud computing virtual resources based on system architecture

Adaptive Resource Allocation for Preemptable Jobs in Cloud Systems.

Adaptive priority-based data placement and multi-task scheduling in geo-distributed cloud systems

An Energy Efficient Task Scheduling Scheme for Heterogeneous GPU-enhanced Clusters