Abstract:With the exploding of data-intensive web applications and requests (tasks), geo-distributed and large-scale data centers (DCs) are widely deployed in Software as a Service (SaaS) cloud, but server failures continue to grow at the same time. In this context, task scheduling problems become more intricate and both scheduling quality and scheduling speed raise further concerns. In this paper, we first propose a virtualized & monitoring SaaS model with predictive maintenance to minimize the costs of fault tolerance. Then with the monitored and predicted available states of servers, we focus on dynamic real-time task scheduling in geo-distributed and large-scale DCs with heterogeneous servers. Multiple objectives, including the long-term performance benefits, energy and communication costs, are taken into consideration in order to improve scheduling quality. For inter-DC and intra-DC task scheduling, two dynamic programming problems are formulated respectively, but there exists the problem that both state and action spaces are too large to be solved by simple iterations. To address this issue, we introduce the idea of reinforcement learning theory into solving traditional stochastic dynamic programming problems in the large-scale SaaS cloud, and put forward a cascaded two-level (inter-DC and intra-DC level) approximate dynamic programming (ADP) task-scheduling algorithm. The computation complexity can be significantly reduced and scheduling speed can be greatly improved. Finally, we conduct experiments with both random simulation data and Google cloud trace-logs. QoS evaluations and comparisons demonstrate that two ADP algorithms can work cooperatively, and our two-level ADP algorithm is more effective under large quantity of bursty requests.

Expectation and SAA Models and Algorithms for Scheduling of Multiple Earth Observation Satellites under the Impact of Clouds

Research on Optimal Two Element Exchange Algorithm for Large Scale Cloud Computing Server Scheduling Problem

Online Cost-Aware Service Requests Scheduling in Hybrid Clouds for Cloud Bursting

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Scheduling multiple agile Earth observation satellites with multiple observations

A Data-Driven Parallel Scheduling Approach for Multiple Agile Earth Observation Satellites

Simulated annealing based heuristic for multiple agile satellites scheduling under cloud coverage uncertainty

Highly Complex Resource Scheduling for Stochastic Demands in Heterogeneous Clouds

Agile Earth Observation Satellite Scheduling Algorithm for Emergency Tasks Based on Multiple Strategies

Multiple agile Earth observation satellites, oversubscribed targets scheduling using complex networks theory

Reasoning-Based Scheduling Method for Agile Earth Observation Satellite with Multi-Subsystem Coupling

A Multiple Agile Satellite Staring Observation Mission Planning Method for Dense Regions

Market-oriented online bi-objective service scheduling for pleasingly parallel jobs with variable resources in cloud environments

Two-level Task Scheduling with Multi-Objectives in Geo-Distributed and Large-Scale SaaS Cloud

A Direct Approach for Solving Cloud Computing Task Assignment with Soft Deadlines

Auction-based and Distributed Optimization Approaches for Scheduling Observations in Satellite Constellations with Exclusive Orbit Portions

Long-Term Multi-objective Task Scheduling with Diff-Serv in Hybrid Clouds

A Service-oriented Scheduling Combination Strategy on Cloud Platforms Based on A Dual-Layer QoS Evaluation Model

Monitoring-Based Task Scheduling In Large-Scale Saas Cloud

Satellite Observation Scheduling with a Novel Adaptive Simulated Annealing Algorithm and a Dynamic Task Clustering Strategy

Coordinated Scheduling of Air and Space Observation Resources Via Divide and Conquer Framework and Iterative Optimization