Abstract:Cloud computing has become a popular technology for executing scientific workflows. However, with a large number of hosts and virtual machines (VMs) being deployed, the cloud resource failures, such as the permanent failure of hosts (HPF), the transient failure of hosts (HTF), and the transient failure of VMs (VMTF), bring the service reliability problem. Therefore, fault tolerance for time-consuming scientific workflows is highly essential in the cloud. However, existing fault-tolerant (FT) approaches consider only one or two above failure types and easily neglect the others, especially for the HTF. This paper proposes a Real-time and dynamic Fault-tolerant Scheduling (ReadyFS) algorithm for scientific workflow execution in a cloud, which guarantees deadline constraints and improves resource utilization even in the presence of any resource failure. Specifically, we first introduce two FT mechanisms, i.e., the replication with delay execution (RDE) and the checkpointing with delay execution (CDE), to cope with HPF and VMTF, simultaneously. Additionally, the rescheduling (ReSC) is devised to tackle the HTF that affects the resource availability of the entire cloud datacenter. Then, the resource adjustment (RA) strategy, including the resource scaling-up (RS-Up) and the resource scaling-down (RS-Down), is used to adjust resource demands and improve resource utilization dynamically. Finally, the ReadyFS algorithm is presented to schedule real-time scientific workflows by combining all the above FT mechanisms with RA strategy. We conduct the performance evaluation with real-world scientific workflows and compare ReadyFS with five vertical comparison algorithms and three horizontal comparison algorithms. Simulation results confirm that ReadyFS is indeed able to guarantee the fault tolerance of scientific workflow execution and improve cloud resource utilization.

ODRE Workshop: Probabilistic Dynamic Hard Real-Time Scheduling in HPC

Industrial Control via Application Containers:Maintaining determinism in IAAS

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

A Decomposition-Based Approach for Multitask Scheduling with Execution Uncertainty in Industrial Internet of Things

Proactive Scheduling and Reactive Real-Time Control in Industry 4.0

Edge computing-based real-time scheduling for digital twin flexible job shop with variable time window

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

Spatial–temporal out-of-order execution for advanced planning and scheduling in cyber-physical factories

Real-Time Scheduling Upon a Host-Centric Acceleration Architecture with Data Offloading

Efficient Probabilistic Workflow Scheduling for IaaS Clouds

Task Offloading in Real-Time Distributed Energy Power Systems

Computational-Intelligence-Based Scheduling with Edge Computing in Cyber–Physical Production Systems

Deadline aware virtual machine scheduler for scientific grids and cloud computing

Container-based real-time scheduling in the Linux kernel

Offloading Real-Time Tasks in IIoT Environments under Consideration of Networking Uncertainties

Online Multi-Workflow Scheduling under Uncertain Task Execution Time in IaaS Clouds

Application of Virtualization Technologies in Novel Industrial Automation: Catalyst or Show-Stopper?

Hybrid Workflow Scheduling on Edge Cloud Computing Systems

HDOT -- an Approach Towards Productive Programming of Hybrid Applications

Real-Time Decision-Support System for High-Mix Low-Volume Production Scheduling in Industry 4.0

Real-time and Dynamic Fault-Tolerant Scheduling for Scientific Workflows in Clouds