Abstract:Network slicing (NS) has been widely identified as a key architectural technology for 5G-and-beyond systems by supporting divergent requirements in a sustainable way. In radio access network (RAN) slicing, due to the device-base station (BS)-NS three layer association relationship, device association (including access control and handoff management) becomes an essential yet challenging issue. With the increasing concerns on stringent data security and device privacy, exploiting local resources to solve device association problem while enforcing data security and device privacy becomes attractive. Fortunately, recently emerging federated learning (FL), a distributed learning paradigm with data protection, provides an effective tool to address this type of issues in mobile networks. In this paper, we propose an efficient device association scheme for RAN slicing by exploiting a hybrid FL reinforcement learning (HDRL) framework, with the aim to improve network throughput while reducing handoff cost. In our proposed framework, individual smart devices train a local machine learning model based on local data and then send the model features to the serving BS/encrypted party for aggregation, so as to efficiently reduce bandwidth consumption for learning while enforcing data privacy. Specifically, we use deep reinforcement learning to train the local model on smart devices under a hybrid FL framework, where horizontal FL is employed for parameter aggregation on BS, while vertical FL is employed for NS/BS pair selection aggregation on the encrypted party. Numerical results show that the proposed HDRL scheme can achieve significant performance gain in terms of network throughput and communication efficiency in comparison with some state-of-the-art solutions.

Mobility aware and energy-efficient federated deep reinforcement learning assisted resource allocation for 5G-RAN slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Federated Deep Reinforcement Learning for Resource Allocation in O-RAN Slicing

Multi-Agent Deep Reinforcement Learning Joint Beamforming for Slicing Resource Allocation

Toward an Efficient and Dynamic Allocation of Radio Access Network Slicing Resources for 5G Era

Intelligent Resource Slicing for eMBB and URLLC Coexistence in 5G and Beyond: A Deep Reinforcement Learning Based Approach

Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

RAN Slice Strategy Based on Deep Reinforcement Learning for Smart Grid

Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

Towards efficient RAN slicing: A deep hierarchical reinforcement learning approach

Device Association for RAN Slicing Based on Hybrid Federated Deep Reinforcement Learning

On the Specialization of FDRL Agents for Scalable and Distributed 6G RAN Slicing Orchestration

Evolutionary Deep Reinforcement Learning for Dynamic Slice Management in O-RAN

Intelligent Resource Scheduling for 5G Radio Access Network Slicing

Hierarchical Meta-Reinforcement Learning for Resource-Efficient Slicing in O-RAN

A Federated Reinforcement Learning Framework via a Committee Mechanism for Resource Management in 5G Networks

Generalizable 5G RAN/MEC Slicing and Admission Control for Reliable Network Operation

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Resource Allocation Approach for Wireless Networks Considering Network Slicing Paradigm