Abstract:As user-generated data diversifies, an increasing number of big data tasks now encompass unstructured data forms, including audio, imagery, and video content. The processing of these data often requires the support of GPU devices in the cluster. However, most of the existing cluster resource management frameworks lack effective decoupling of CPU resources and GPU resources, and the management granularity of GPU resources is too coarse, resulting in poor GPU sharing and low resource utilization. Given, for the inadequacy of the existing cluster resource management framework that cannot support batch stream integration and CPU-GPU resource scheduling, we design and implement a Hybrid Heterogeneous Resource Management (H-HRM) for CPU-GPU heterogeneous clusters. The resource queue binding mechanism on computing nodes provides flexible binding of CPU resources to GPU resources, which solves the problem that CPU resources and GPU resources in the cluster are difficult to decouple. According to the different uses of CPU or GPU as the main resource, a Hybrid Domain Resource Fairness (HDRF) model is proposed to realize the reasonable allocation of CPU resources and GPU resources. Through the queue stacking technology and the mechanism that multiple executors can run simultaneously on the queue, fine-grained sharing of GPU resources is realized and the utilization rate of GPU resources is improved. Finally, this paper realizes the docking of H-HRM and Spark programming framework and conducts real load tests, and after comparing with the performance of Mesos, it is proved that H-HRM can handle the mixed scenarios of batch jobs and stream processing jobs in the cluster, and the HDRF algorithm also greatly improves the utilization of the GPU.

GPUhd: Augmenting YARN with GPU Resource Management

New YARN sharing GPU based on graphics memory granularity scheduling

Hybrid Map Task Scheduling for GPU-Based Heterogeneous Clusters

A Virtual Multi-Channel GPU Fair Scheduling Method for Virtual Machines.

Exploring the Diversity of Multiple Job Deployments over GPUs for Efficient Resource Sharing

Design and realization of hybrid resource management system for heterogeneous cluster

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

A MapReduce Computing Framework Based on GPU Cluster.

Orchestrated Co-scheduling, Resource Partitioning, and Power Capping on CPU-GPU Heterogeneous Systems via Machine Learning

KubeGPU: efficient sharing and isolation mechanisms for GPU resource management in container cloud

Hierarchical Resource Partitioning on Modern GPUs: A Reinforcement Learning Approach

Efficient Resource Sharing Through GPU Virtualization on Accelerated High Performance Computing Systems

High Performance Computing Via a GPU

HyTGraph: GPU-Accelerated Graph Processing with Hybrid Transfer Management

Efficient GPU Spatial-Temporal Multitasking

Extending the ARC Information Providers to report information on GPU resources

Simultaneous Multikernel GPU: Multi-tasking throughput processors via fine-grained sharing

A CPU-GPGPU Scheduler Based on Data Transmission Bandwidth of Workload

Task Scheduling for GPU Heterogeneous Cluster.

Improving GPU Performance Through Resource Sharing