Abstract:In recent years, Mobile Edge Computing (MEC) in 5G network has emerged as a promising paradigm with the development of the 5G. By setting up serving nodes at the edge of the network, it can be enabled for mobile devices to offload their computing tasks to the edge nodes, to achieve a lower response time and save more device power. However, due to the limited capacity of the edge nodes, it is important to implement a reasonable resource allocation method. Auto-scaling is a technology which can automatically adjusts computing resources between the containers at edge nodes, according to the demands and the strategies, to achieve a balance between the system costs and Quality of Service (QoS). To find this balance, many researchers have proposed different auto-scaling algorithms, e.g. rule-based algorithms, reinforcement learning-based algorithms, etc. For the algorithms based on reinforcement learning, most of the researchers have applied Q-Learning in auto-scaling and achieved good results, proving the feasibility of the reinforcement learning. However, the Q-Learning algorithm can only select actions in a limited action space, thus it cannot achieve a more precise control. Therefore, in this paper, based on the Markov Decision Process (MDP), we propose an auto-scaling algorithm based on the Proximal Policy Optimization (PPO), replacing the discrete action space with a continuous action space, to achieve a more precise control. Experiment shows that compared to the no-scaling method and the Q-Learning algorithm, our proposed algorithm has achieved an overall improvement of 96.9% and 86.6%, respectively.

Adaptive Auto-Scaling in Mobile Edge Computing: A Deep Reinforcement Learning Approach

Autoscaling in Mobile Edge Computing Based on Multi-Agent Reinforcement Learning

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Mobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning

A Multi-Agent Deep Reinforcement Learning Approach for Computation Offloading in 5G Mobile Edge Computing

Smart Collaborative Optimizations Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep Reinforcement Learning Approach for Enhancing Profitability in Mobile Edge Computing

Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Performance-Aware Adaptive Resource Allocation in Mobile Edge Computing

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Optimization of Lightweight Task Offloading Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Age-Based Scheduling for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning