Abstract:Network slicing (NS) is an emerging technology in recent years, which enables network operators to slice network resources (e.g., bandwidth, power, spectrum, etc.) in different types of slices, so that it can adapt to different application scenarios of 5 g network: enhanced mobile broadband (eMBB), massive machine-type communications (mMTC) and ultra-reliable and low-latency communications (URLLC). In order to allocate these sliced network resources more effectively to users with different needs, it is important that manage the allocation of network resources. Actually, in the practical network resource allocation problem, the resources of the base station (BS) are limited and the demand of each user for mobile services is different. To better deal with the resource allocation problem, more effective methods and algorithms have emerged in recent years, such as the bidding method, deep learning (DL) algorithm, ant colony algorithm (AG), and wolf colony algorithm (WPA). This paper proposes a two tier slicing resource allocation algorithm based on Deep Reinforcement Learning (DRL) and joint bidding in wireless access networks. The wireless virtual technology divides mobile operators into infrastructure providers (InPs) and mobile virtual network operators (MVNOs). This paper considers a single base station, multi-user shared aggregated bandwidth radio access network scenario and joins the MVNOs to fully utilize base station resources, and divides the resource allocation process into two tiers. The algorithm proposed in this paper takes into account both the utilization of base station (BS) resources and the service demand of mobile users (MUs). In the upper tier, each MVNO is treated as an agent and uses a combination of bidding and Deep Q network (DQN) allows the MVNO to get more resources from the base station. In the lower tier allocation process, each MVNO distributes the received resources to the users who are connected to it, which also uses the Dueling DQN method for iterative learning to find the optimal solution to the problem. The results show that in the upper tier, the total system utility function and revenue obtained by the proposed algorithm are about 5.4% higher than double DQN and about 2.6% higher than Dueling DQN; In the lower tier, the user service quality obtained by using the proposed algorithm is more stable, the system utility function and Se are about 0.5-2.7% higher than DQN and Double DQN, but the convergence is faster.

Blockchain-Based Computing Resource Trading in Autonomous Multi-Access Edge Network Slicing: A Dueling Double Deep Q-Learning Approach

Blockchain-Enabled Resource Trading and Deep Reinforcement Learning-Based Autonomous RAN Slicing in 5G

Blockchain-Enabled Federated Learning-Based Resource Allocation and Trading for Network Slicing in 5G

Stackelberg Game Based Dynamic Resource Trading for Network Slicing in 5g Networks

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

Two-Tier Resource Allocation for Multitenant Network Slicing: A Federated Deep Reinforcement Learning Approach

Consortium Blockchain-Based Spectrum Trading for Network Slicing in 5G RAN: A Multi-Agent Deep Reinforcement Learning Approach

Competitive Pricing for Resource Trading in Sliced Mobile Networks: A Multi-Agent Reinforcement Learning Approach

MEC Network Slicing: Stackelberg-Game-Based Slice Pricing and Resource Allocation with QoS Guarantee

Deep Reinforcement Learning for Edge Computing Resource Allocation in Blockchain Network Slicing Broker Framework

Blockchain-Based Edge Collaboration with Incentive Mechanism for MEC-Enabled VR Systems

Cooperative Resource Trading for Network Slicing in Industrial IoT: A Multi-Agent DRL Approach

Two Tier Slicing Resource Allocation Algorithm Based on Deep Reinforcement Learning and Joint Bidding in Wireless Access Networks

AN INTELLIGENT NETWORK SLICING FRAMEWORK FOR DYNAMIC RESOURCE SHARING IN MULTI-ACCESS EDGE COMPUTING ENABLED NETWORKS

Blockchain as a Service for Multi-Access Edge Computing: A Deep Reinforcement Learning Approach

Dynamic Network Slicing and Resource Allocation in Mobile Edge Computing Systems

Distributed Resource Allocation for Network Slicing over Licensed and Unlicensed Bands

Resource Allocation in Blockchain Integration of UAV-Enabled MEC Networks: A Stackelberg Differential Game Approach

Reinforcement-Learning Based Network Slicing and Resource Allocation for Multi-Access Edge Computing Networks

SGCS: An Intelligent Stackelberg Game-Based Computation Offloading and Resource Pricing Scheme in Blockchain-Enabled MEC for IIoT

Cloud–Edge Collaborative Resource Allocation for Blockchain-Enabled Internet of Things: A Collective Reinforcement Learning Approach