Abstract:The rapid development of mobile device applications put tremendous pressure on edge nodes with limited computing capabilities, which may cause poor user experience. To solve this problem, collaborative cloud-edge computing is proposed. In the cloud-edge computing, an edge node with limited local resources can rent more resources from a cloud node. According to the nature of cloud service, cloud service can be divided into private cloud and public cloud. In a private cloud environment, the edge node must allocate resources between the cloud node and the edge node. In a public cloud environment, since public cloud service providers offer various pricing modes for users' different computing demands, the edge node also must select the appropriate pricing mode of cloud service; which is a sequential decision problem. In this stydy, we model it as a Markov decision process and parameterized action Markov decision process, and we propose a resource allocation algorithm cost efficient resource allocation with private cloud (CERAI) and cost efficient resource allocation with public cloud (CERAU) in the collaborative cloud-edge environment based on the deep reinforcement learning algorithm deep deterministic policy gradient and P-DQN. Next, we evaluated CERAI and CERAU against three typical resource allocation algorithms based on synthetic and real data of Google datasets. The experimental results demonstrate that CERAI and CERAU can effectively reduce the long-term operating cost of collaborative cloud-side computing in various demanding settings. Our analysis can provide some useful insights for enterprises to design the resource allocation strategy in the collaborative cloud-side computing system.

Efficient Resource Allocation Policy for Cloud Edge End Framework by Reinforcement Learning

Delay-Aware Stochastic Resource Management for Mobile Edge Computing Systems Via Constrained Reinforcement Learning

Mobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning

Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Computation Offloading and Resource Allocation for MEC

Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Energy and Delay-Aware Task Offloading and Resource Allocation in Mobile Edge Computing

Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System

Heuristically Assisted Multiagent RL-Based Framework for Computation Offloading and Resource Allocation of Mobile-Edge Computing.

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Reinforcement Learning-Based Resource Allocation in Edge Computing

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Intelligent Resource Allocation for Edge-Cloud Collaborative Networks: A Hybrid DDPG-D3QN Approach

Joint Computation Offloading and Service Caching in Mobile Edge-Cloud Computing Via Deep Reinforcement Learning