Abstract:Compared to traditional distributed computing environments such as grids, cloud computing provides a more cost-effective way to deploy scientific workflows. Each task of a scientific workflow requires several large datasets that are located in different datacenters from the cloud computing environment, resulting in serious data transmission delays. Edge computing reduces the data transmission delays and supports the fixed storing manner for scientific workflow private datasets, but there is a bottleneck in its storage capacity. It is a challenge to combine the advantages of both edge computing and cloud computing to rationalize the data placement of scientific workflow, and optimize the data transmission time across different datacenters. Traditional data placement strategies maintain load balancing with a given number of datacenters, which results in a large data transmission time. In this study, a self-adaptive discrete particle swarm optimization algorithm with genetic algorithm operators (GA-DPSO) was proposed to optimize the data transmission time when placing data for a scientific workflow. This approach considered the characteristics of data placement combining edge computing and cloud computing. In addition, it considered the impact factors impacting transmission delay, such as the band-width between datacenters, the number of edge datacenters, and the storage capacity of edge datacenters. The crossover operator and mutation operator of the genetic algorithm were adopted to avoid the premature convergence of the traditional particle swarm optimization algorithm, which enhanced the diversity of population evolution and effectively reduced the data transmission time. The experimental results show that the data placement strategy based on GA-DPSO can effectively reduce the data transmission time during workflow execution combining edge computing and cloud computing.

A New Particle Swarm Optimization-Based Strategy for Cost-Effective Data Placement in Scientific Cloud Workflows

A Data Placement Strategy for Scientific Workflow in Hybrid Cloud

A Novel Workflow-Level Data Placement Strategy for Data-Sharing Scientific Cloud Workflows

A Novel Data Placement Strategy for Data-Sharing Scientific Workflows in Heterogeneous Edge-Cloud Computing Environments

Optimal Data Placement for Data-Sharing Scientific Workflows in Heterogeneous Edge-Cloud Computing Environments

A Time-driven Data Placement Strategy for a Scientific Workflow Combining Edge Computing and Cloud Computing

A Novel Cost-Aware Data Placement Strategy for Edge-Cloud Collaborative Smart Systems

A Cost-Effective Strategy for Storing Scientific Datasets with Multiple Service Providers in the Cloud

Effective Data Placement for Scientific Workflows in Mobile Edge Computing Using Genetic Particle Swarm Optimization.

Cost-Driven Scheduling for Deadline-Based Workflow Across Multiple Clouds.

Fuzzy Theory-Based Data Placement for Scientific Workflows in Hybrid Cloud Environments

A Two-Step Data Placement and Task Scheduling Strategy for Optimizing Scientific Workflow Performance on Cloud Computing Platform

Data Placement Strategy of Scientific Workflow Based on Fuzzy Theory in Hybrid Cloud

DATA PLACEMENT STRATEGY BASED ON MULTI-OBJECTIVE OPTIMIZATION FOR SCIENTIFIC WORKFLOWS IN CLOUD COMPUTING ENVIRONMENT

A Data Placement Strategy for Data-Intensive Scientific Workflows in Cloud

Scientific Workflows in IoT Environments: A Data Placement Strategy Based on Heterogeneous Edge-Cloud Computing

Scheduling Strategy for Science Workflow with Deadline Constraint on Multi-Cloud

A Security and Cost Aware Scheduling Algorithm for Heterogeneous Tasks of Scientific Workflow in Clouds

A Clustering Based Coscheduling Strategy for Efficient Scientific Workflow Execution in Cloud Computing.

IPSO: Improved Particle Swarm Optimization Based Task Scheduling at the Cloud Data Center

Minimizing Monetary Costs for Deadline Constrained Workflows in Cloud Environments