Abstract:With the rapid development of cloud computing, the increasing scale of clusters and task parallelism put forward higher requirements on the scheduling capability at scale. To this end, the shared-state scheduler architecture has emerged as the popular solution for large-scale scheduling due to its high scalability and utilization. In such an architecture, a central resource state view periodically updates the global cluster status to distributed schedulers for parallel scheduling. However, the schedulers obtain broader resource views at the cost of intermittently stale states, rendering resources released invisible to schedulers until the next view update. These fleeting resource fragments are referred to as shadow resources in this paper. Current shared-state solutions overlook or fail to systematically utilize the shadow resources, leaving a void in fully exploiting these invisible resources. In this paper, we present a thorough analysis of shadow resources through theoretic modeling and extensive experiments. In order to systematically utilize these resources, we propose Resource Miner (RMiner), a hybrid scheduling sub-system on top of the shared-state scheduler architecture. RMiner comprises three cooperative components: a shadow resource manager that efficiently manages shadow resources, an RM filter that selects suitable tasks as RM tasks, and an RM scheduler that allocates shadow resources to RM tasks. In total, our design enhances the visibility of shared-state scheduling solutions by adding manageability to invisible resources. Through extensive trace-driven evaluation, we show that RMiner greatly outperforms current shared-state schedulers in terms of resource utilization, task throughput, and job wait time with only minor costs of scheduling conflicts and overhead.

Not All Resources are Visible: Exploiting Fragmented Shadow Resources in Shared-State Scheduler Architecture

Local Adaptive Resource Scheduling for Internet-Based Computation on SMT Platform

A Swarm-Inspired Resource Distribution for SMT Processors.

A Dynamic Resource Allocation Optimization for SMT Processors

ROSE: Cluster Resource Scheduling Via Speculative Over-Subscription

Real-time scheduling for parallel tasks with resource reclamation

Performance-Aware Speculative Resource Oversubscription for Large-Scale Clusters

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Improving resource utilization by timely fine-grained scheduling

Resource Efficient Isolation Mechanisms in Mixed-Criticality Scheduling

A Resource Representing Framework Enabling Dynamic Resource Discovery and Access Optimization.

Multiple Resources Scheduling for Diverse Workloads in Heterogeneous Datacenter

Self-adaptive Resource Management for Large-Scale Shared Clusters

MRSch: Multi-Resource Scheduling for HPC

Resource Management for Moldable Parallel Tasks Supporting Slot Time in the Cloud

Multi-Tiered On-Demand Resource Scheduling for VM-Based Data Center

Mitigating Resource Contention on Multicore Systems Via Scheduling

Fine-grained Scheduling in Multi-Resource Clusters

Intelligent Resource Scheduling at Scale: A Machine Learning Perspective

UDRF: Multi-Resource Fairness for Complex Jobs with Placement Constraints

An Adaptive Online Scheme for Scheduling and Resource Enforcement in Storm.