Abstract:Cloud computing has become a popular technology for executing scientific workflows. However, with a large number of hosts and virtual machines (VMs) being deployed, the cloud resource failures, such as the permanent failure of hosts (HPF), the transient failure of hosts (HTF), and the transient failure of VMs (VMTF), bring the service reliability problem. Therefore, fault tolerance for time-consuming scientific workflows is highly essential in the cloud. However, existing fault-tolerant (FT) approaches consider only one or two above failure types and easily neglect the others, especially for the HTF. This paper proposes a Real-time and dynamic Fault-tolerant Scheduling (ReadyFS) algorithm for scientific workflow execution in a cloud, which guarantees deadline constraints and improves resource utilization even in the presence of any resource failure. Specifically, we first introduce two FT mechanisms, i.e., the replication with delay execution (RDE) and the checkpointing with delay execution (CDE), to cope with HPF and VMTF, simultaneously. Additionally, the rescheduling (ReSC) is devised to tackle the HTF that affects the resource availability of the entire cloud datacenter. Then, the resource adjustment (RA) strategy, including the resource scaling-up (RS-Up) and the resource scaling-down (RS-Down), is used to adjust resource demands and improve resource utilization dynamically. Finally, the ReadyFS algorithm is presented to schedule real-time scientific workflows by combining all the above FT mechanisms with RA strategy. We conduct the performance evaluation with real-world scientific workflows and compare ReadyFS with five vertical comparison algorithms and three horizontal comparison algorithms. Simulation results confirm that ReadyFS is indeed able to guarantee the fault tolerance of scientific workflow execution and improve cloud resource utilization.

Adaptive Fault-Tolerant Scheduling In Heterogeneous Real-Time Systems

An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

Fault Tolerant Real-Time Scheduling Strategy for NC System Based on Rollback Recovery

Research on Real-Time Scheduling Strategy for Transient Fault Tolerance in Nc System

Local Adaptive Resource Scheduling for Internet-Based Computation on SMT Platform

Fault-tolerant real-time tasks scheduling with dynamic fault handling

Research on Joint Optimal Scheduling of Task Energy Efficiency and Reliability in Heterogeneous Multiprocessor Real-time System

Efficient Scheduling Algorithm for Hard Real-Time Tasks in Primary-Backup Based Multiprocessor Systems

Fault Tolerance in Real Time Multiprocessors - Embedded Systems

Optimized Scheduling Algorithm Oriented to Numerical Control System

Real-time and Dynamic Fault-Tolerant Scheduling for Scientific Workflows in Clouds

Time Analysis for Fault-Tolerant Real-Time Group-Based Scheduling

Real Time Performance Evaluation for Dynamic Scheduling Algorithm

Energy-Efficient Fault-Tolerant Mapping and Scheduling on Heterogeneous Multiprocessor Real-Time Systems

Online Task Scheduling for Heterogeneous Reconfigurable Systems

A Novel Heterogeneous Scheduling Algorithm with Improved Task Priority

High Performance Real-Time Scheduling of Multiple Mixed-Criticality Functions in Heterogeneous Distributed Embedded Systems

Partial preemptive real-time scheduling algorithm in software fault-tolerant model

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

A Hybrid Task Schedule Algorithm for Real-Time System Employing Trusted Computing Technology

Supporting Fault-Tolerance for Time-Critical Events in Distributed Environments