Abstract:Compared to traditional distributed computing environments such as grids, cloud computing provides a more cost-effective way to deploy scientific workflows. Each task of a scientific workflow requires several large datasets that are located in different datacenters from the cloud computing environment, resulting in serious data transmission delays. Edge computing reduces the data transmission delays and supports the fixed storing manner for scientific workflow private datasets, but there is a bottleneck in its storage capacity. It is a challenge to combine the advantages of both edge computing and cloud computing to rationalize the data placement of scientific workflow, and optimize the data transmission time across different datacenters. Traditional data placement strategies maintain load balancing with a given number of datacenters, which results in a large data transmission time. In this study, a self-adaptive discrete particle swarm optimization algorithm with genetic algorithm operators (GA-DPSO) was proposed to optimize the data transmission time when placing data for a scientific workflow. This approach considered the characteristics of data placement combining edge computing and cloud computing. In addition, it considered the impact factors impacting transmission delay, such as the band-width between datacenters, the number of edge datacenters, and the storage capacity of edge datacenters. The crossover operator and mutation operator of the genetic algorithm were adopted to avoid the premature convergence of the traditional particle swarm optimization algorithm, which enhanced the diversity of population evolution and effectively reduced the data transmission time. The experimental results show that the data placement strategy based on GA-DPSO can effectively reduce the data transmission time during workflow execution combining edge computing and cloud computing.

Optimizing Data Placement in Multi-cloud Environments Considering Data Temperature

AI-oriented Workload Allocation for Cloud-Edge Computing.

Optimal Data Placement for Data-Sharing Scientific Workflows in Heterogeneous Edge-Cloud Computing Environments

Towards Optimizing Storage Costs on the Cloud

A Novel Data Placement Strategy for Data-Sharing Scientific Workflows in Heterogeneous Edge-Cloud Computing Environments

Thermal-Aware Task Placement with Dynamic Thermal Model in an Established Datacenter

A Time-driven Data Placement Strategy for a Scientific Workflow Combining Edge Computing and Cloud Computing

A Cost-Effective Strategy for Storing Scientific Datasets with Multiple Service Providers in the Cloud

Scientific Workflows in IoT Environments: A Data Placement Strategy Based on Heterogeneous Edge-Cloud Computing

Big Data Storage Index Mechanism Based on Spatiotemporal Information Cloud Platform

Stochastic programming on cost optimization in geographically distributed Internet data centers

An Effective Data Placement Strategy for IIoT Applications

Cooling-Aware Energy and Workload Management in Data Centers Via Stochastic Optimization

Security-aware intermediate data placement strategy in scientific cloud workflows

Dynamic Pricing and Profit Maximization for the Cloud with Geo-Distributed Data Centers.

Multi-objective data placement for multi-cloud socially aware services

Robust Workload and Energy Management for Sustainable Data Centers

Spatio-Temporal Load Balancing for Energy Cost Optimization in Distributed Internet Data Centers

Data Placement for Multi-Tenant Data Federation on the Cloud

A Data Placement Strategy for Scientific Workflow in Hybrid Cloud

Adaptive priority-based data placement and multi-task scheduling in geo-distributed cloud systems