Abstract:With the rapid development of edge-cloud computing, distributing resources to edge nodes and terminal devices to provide high-quality services for latency-sensitive applications and reduce network communication costs has become increasingly important. However, the complexity and heterogeneity of the edge-cloud environment pose significant challenges to the reliability of data storage and device load balancing. To address these issues, in this paper, we propose a Deep Reinforcement Learning (DRL)-based data replica placement scheme, BRPS. This scheme considers the different geographic locations of hardware devices, the heterogeneous storage capacity and reliability, and the different data requirements of varying user services in edge-cloud environments. Firstly, we constructed a model for data replica placement in the edge-cloud environment, addressing key factors such as latency, reliability, and load, focusing on the heterogeneity of device resources and reliability, and the diverse data needs of user services. Furthermore, we propose the BRPS scheme using the Double Deep Q-Network (DDQN) method of DRL, transforming the data replica placement issue into a multi-objective optimization problem. By placing the DRL-based decision process in a separate management edge node, the separation of decision and execution is achieved, which enhances the efficiency of data replica placement, ensures data reliability, reduces latency, and achieves system load balance. Experimental results demonstrate that BRPS significantly outperforms the existing comparison schemes while ensuring data reliability. The BRPS scheme reduces latency by 8.12% compared to the Random scheme and outperforms the best heuristic in system load balancing and memory utilization by 13.15% and 11.91%, respectively. Moreover, BRPS shows superior adaptability in extreme network congestion scenarios and effectively adapts to the dynamic changes of nodes in edge-cloud environments.

Efficient Data Replica Placement for Sensor Clouds.

Efficient Data Cache Allocation for Sensor Clouds

Cooperative Data Caching for Cloud Data Servers.

GCplace: geo-cloud based correlation aware data replica placement.

Towards Energy-Efficient Storage Placement in Large Scale Sensor Networks

Privacy-Preserving Resource Management for Distributed Collaborative Edge Caching Systems

Optimized Storage Placement over Large Scale Sensor Networks

Data placement in distributed data centers for improved SLA and network cost

Space Cloudlet Aided Caching Placement Strategy for Remote Mobile Social Networks

An Effective Data Placement Strategy for IIoT Applications

Analysis and Performance Study for Coordinated Hierarchical Cache Placement Strategies

Optimization policy for file replica placement in fog domains

Cache Placement in Fog-RANs: from Centralized to Distributed Algorithms.

QoE-driven social aware caching placement for terrestrial-satellite networks

Cost-aware automatic scaling and workload-aware replica management for edge-cloud environment

CRMS: A centralized replication management scheme for cloud storage system

Edge Caching Data Distribution Strategy with Minimum Energy Consumption

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Joint optimization of cache placement and request routing in unreliable networks

Cache Placement Optimization In Hierarchical Networks: Analysis And Performance Evaluation

A Balanced and Reliable Data Replica Placement Scheme Based on Reinforcement Learning in Edge-Cloud Environments