Abstract:The rapid evolution of user equipment (UE) and 5G networks drives significant transformations, bringing technology closer to end-users. Managing resources in densely crowded areas such as airports, train stations, and bus terminals poses challenges due to diverse user demands. Integrating mobile edge computing (MEC) and network function virtualization (NFV) becomes vital when the service provider's (SP) primary goal is maximizing profitability while maintaining service level agreement (SLA). Considering these challenges, our study addresses an online resource allocation problem in an MEC network where computing resources are limited, and the SP aims to boost profit by securely admitting more UE requests at each time slot. Each UE request arrival rate is unknown, and the requirement is specific resources with minimum cost and delay. The optimization problem objective is achieved by allocating resources to requests at the MEC network in appropriate cloudlets, utilizing abandoned instances, reutilizing idle and soft slice instances to shorten delay and reduce costs, and immediately scaling inappropriate instances, thus minimizing the instantiation of new instances. This paper proposes a deep reinforcement learning (DRL) method for request prediction and resource allocation to mitigate unnecessary resource waste. Simulation results demonstrate that the proposed approach effectively accepts network slice requests to maximize profit by leveraging resource availability, reutilizing instantiated resources, and upholding goodwill and SLA. Through extensive simulations, we show that our proposed DRL-based approach outperforms other state-of-the-art techniques, namely, MaxSR, DQN, and DDPG, by 76%, 33%, and 23%, respectively. We propose a multi-agent deep reinforcement learning mechanism for end-to-end network slicing in mobile edge computing. Utilizing the advantage actor-critic method, it predicts future user arrivals, ensures resource availability, and optimizes resource allocation to maximize profit and minimize waste. Results show our approach's promising performance. image

Demo: Deep Reinforcement Learning for Resource Management in Cellular Network Slicing.

Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Deep Reinforcement Learning for Resource Management in Network Slicing

DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing

RAN Slice Strategy Based on Deep Reinforcement Learning for Smart Grid

Towards efficient RAN slicing: A deep hierarchical reinforcement learning approach

Deep Reinforcement Learning for Resource Management on Network Slicing: A Survey

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

GAN-based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing

Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network.

Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing

Intelligent Radio Access Network Slicing for Service Provisioning in 6G: A Hierarchical Deep Reinforcement Learning Approach

Constrained Reinforcement Learning for Resource Allocation in Network Slicing

OnSlicing: Online End-to-End Network Slicing with Reinforcement Learning

Two-Tier Resource Allocation in Dynamic Network Slicing Paradigm with Deep Reinforcement Learning

Deep Reinforcement Learning-Based Radio Function Deployment for Secure and Resource-Efficient NG-RAN Slicing

EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics

Dynamic and Efficient Resource Allocation for 5G End-to-end Network Slicing: A Multi-Agent Deep Reinforcement Learning Approach