Abstract:Clouds are becoming an important platform for scientific workflow applications. However, with many nodes being deployed in clouds, managing reliability of resources becomes a critical issue, especially for the real-time scientific workflow execution where deadlines should be satisfied. Therefore, fault tolerance in clouds is extremely essential. The PB (primary backup) based scheduling is a popular technique for fault tolerance and has effectively been used in the cluster and grid computing. However, applying this technique for real-time workflows in a virtualized cloud is much more complicated and has rarely been studied. In this paper, we address this problem. We first establish a real-time workflow fault-tolerant model that extends the traditional PB model by incorporating the cloud characteristics. Based on this model, we develop approaches for task allocation and message transmission to ensure faults can be tolerated during the workflow execution. Finally, we propose a dynamic fault-tolerant scheduling algorithm, FASTER, for realtime workflows in the virtualized cloud. FASTER has three key features: 1) it employs a backward shifting method to make full use of the idle resources and incorporates task overlapping and VM migration for high resource utilization, 2) it applies the vertical/horizontal scaling-up technique to quickly provision resources for a burst of workflows, and 3) it uses the vertical scaling-down scheme to avoid unnecessary and ineffective resource changes due to fluctuated workflow requests. We evaluate our FASTER algorithm with synthetic workflows and workflows collected from the real scientific and business applications and compare it with six baseline algorithms. The experimental results demonstrate that FASTER can effectively improve the resource utilization and schedulability even in the presence of node failures in virtualized clouds.

A novel fault-tolerant scheduling approach for collaborative workflows in an edge-IoT environment

A Fault-Tolerant Workflow Scheduling Method on Deep Reinforcement Learning-Based in Edge Environment

An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

Fault-Tolerant Scheduling Mechanism for Dynamic Edge Computing Scenarios Based on Graph Reinforcement Learning

A Novel Coevolutionary Approach to Reliability Guaranteed Multi-Workflow Scheduling Upon Edge Computing Infrastructures

A Decentralized Latency-Aware Task Allocation and Group Formation Approach with Fault Tolerance for IoT Applications

A Novel Approach To Cost-Efficient Scheduling Of Multi-Workflows In The Edge Computing Environment With The Proximity Constraint

Proximity-constrained and Cost-Efficient Scheduling of Workflows over Edge Computing Resources

Reinforcement Learning Based Online Scheduling of Multiple Workflows in Edge Environment

Reliability-aware and Deadline-constrained Workflow Scheduling in Mobile Edge Computing.

Computation Offloading and Task Scheduling with Fault-Tolerance for Minimizing Redundancy in Edge Computing

Scheduling Multi-workflows over Edge Computing Resources with Time-Varying Performance, A Novel Probability-Mass Function and DQN-Based Approach

Decentralized and Fault-Tolerant Task Offloading for Enabling Network Edge Intelligence

Fault-Tolerant Scheduling for Real-Time Scientific Workflows with Elastic Resource Provisioning in Virtualized Clouds

Energy-Aware Resource Scheduling with Fault-Tolerance in Edge Computing.

Failure-aware Elastic Cloud Workflow Scheduling

A fault‐tolerant dynamic scheduling method on hierarchical mobile edge cloud computing

A Novel Fault-Tolerant Approach to Web Service Composition upon the Edge Computing Environment

Dynamic Fault-Tolerant Workflow Scheduling with Hybrid Spatial-Temporal Re-Execution in Clouds

Optimizing Execution Time and Cost While Scheduling Scientific Workflow in Edge Data Center with Fault Tolerance Awareness

Adaptive Fault-Tolerant Strategy for Latency-Aware IoT Application Executing in Edge Computing Environment