Abstract:With the rapid development of cloud computing, the increasing scale of clusters and task parallelism put forward higher requirements on the scheduling capability at scale. To this end, the shared-state scheduler architecture has emerged as the popular solution for large-scale scheduling due to its high scalability and utilization. In such an architecture, a central resource state view periodically updates the global cluster status to distributed schedulers for parallel scheduling. However, the schedulers obtain broader resource views at the cost of intermittently stale states, rendering resources released invisible to schedulers until the next view update. These fleeting resource fragments are referred to as shadow resources in this paper. Current shared-state solutions overlook or fail to systematically utilize the shadow resources, leaving a void in fully exploiting these invisible resources. In this paper, we present a thorough analysis of shadow resources through theoretic modeling and extensive experiments. In order to systematically utilize these resources, we propose Resource Miner (RMiner), a hybrid scheduling sub-system on top of the shared-state scheduler architecture. RMiner comprises three cooperative components: a shadow resource manager that efficiently manages shadow resources, an RM filter that selects suitable tasks as RM tasks, and an RM scheduler that allocates shadow resources to RM tasks. In total, our design enhances the visibility of shared-state scheduling solutions by adding manageability to invisible resources. Through extensive trace-driven evaluation, we show that RMiner greatly outperforms current shared-state schedulers in terms of resource utilization, task throughput, and job wait time with only minor costs of scheduling conflicts and overhead.

Improving resource utilization by timely fine-grained scheduling

Local Adaptive Resource Scheduling for Internet-Based Computation on SMT Platform

A Dynamic Resource Allocation Optimization for SMT Processors

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Mitigating Resource Contention on Multicore Systems Via Scheduling

Improving Cluster Resource Efficiency with Oversubscription

A HPC Co-Scheduler with Reinforcement Learning

A User-Level NUMA-Aware Scheduler for Optimizing Virtual Machine Performance.

Achieving better Resource Utilization by Implementing a High-Performance Intelligent Framework in a Distributed Environment

New Scheduling Algorithms for Improving Performance and Resource Utilization in Hadoop YARN Clusters

A Resourceful Coordination Approach for Multilevel Scheduling

Not All Resources are Visible: Exploiting Fragmented Shadow Resources in Shared-State Scheduler Architecture

Utilization-Based Scheduling of Flexible Mixed-Criticality Real-Time Tasks

Sonnet: A control-theoretic approach for resource allocation in cluster management

Holistic Resource Allocation Under Federated Scheduling for Parallel Real-time Tasks

A heuristic method for data allocation and task scheduling on heterogeneous multiprocessor systems under memory constraints

Analysis and Improvement of Makespan and Utilization for MapReduce

Resource Management for Moldable Parallel Tasks Supporting Slot Time in the Cloud

Preemptive and Low Latency Datacenter Scheduling via Lightweight Containers

Real-time scheduling for parallel tasks with resource reclamation