Abstract:A deep reinforcement learning‐based dual connectivity handover strategy for mmWave cellular networks was proposed to select the optimal handover target node, and simulation results show that the algorithm can minimize unnecessary handovers, reduce service interruption time, and achieve the highest throughput in comparing with others algorithms. Millimeter wave (mmWave) technology, with its abundant spectrum resources and ultra‐high bandwidth, plays a crucial role in meeting the ultra‐high throughput requirements of future 6G communication and supporting a large number of device connections. However, mmWave signals are highly susceptible to congestion, and the channel quality in mmWave links can be extremely unstable, posing a significant challenge to mobility management in mmWave networks. In this article, we present a deep reinforcement learning‐based dual connectivity (DC) handover strategy for mmWave cellular networks. The DC architecture ensures a continuous connection to the core network, reducing the likelihood of frequent service interruptions. Additionally, the proposed handover strategy employs deep reinforcement learning to select the optimal handover target node, further enhancing system performance. Compared to traditional single connectivity (SC) handover strategies, DC involves more intricate handover trigger conditions and processes. We extend several typical SC handover algorithms for DC and compare them with the proposed algorithms in this study. Through numerical simulations, we evaluate the performance of these algorithms. The results demonstrate that the proposed algorithm minimizes unnecessary handovers, reduces service interruption time, and achieves the highest throughput.

Multiagent Q-Learning-Based Mobility Management for Multi-Connectivity in mmWAVE Cellular Systems

Multi-Agent Q-Learning for Real-Time Load Balancing User Association and Handover in Mobile Networks

Energy-Efficient Cooperative Transmission in Ultra-Dense Millimeter-Wave Network: Multi-Agent Q-Learning Approach

Millimeter-Wave Network Handover Control Based on Multi-Agent System

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Double‐deep Q‐learning‐based handover management in mmWave heterogeneous networks with dual connectivity

QoS Optimization for Mobile Ad Hoc Cloud: A Multi-Agent Independent Learning Approach

Mobility-Aware Resource Allocation for mmWave IAB Networks: A Multi-Agent Reinforcement Learning Approach

Reinforcement Learning Based Computation-aware Mobility Management in Ultra Dense Networks

Learning-based Load Balancing Handover in Mobile Millimeter Wave Networks

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Distributed Adaptive Multiuser Scheduling Via Multi-Agent Reinforcement Learning in Multicell MIMO Cellular Networks

Multi-agent Q-learning Based Admission Control Mechanism in Heterogeneous Wireless Networks for Multiple Services.

Multi-Agent Deep Reinforcement Learning for Massive Access in 5G and Beyond Ultra-Dense NOMA System

Transfer Reinforcement Learning for 5G-NR mm-Wave Networks

A Multi-Agent DRL Method for Distributed Energy-Efficient Association and Hybrid Precoding in Mmwave Cell-Free Massive MIMO Systems

Distributed Q-Learning Aided Uplink Grant-Free NOMA for Massive Machine-Type Communications.

Optimal Handover Policy for Mmwave Cellular Networks: A Multi-Armed Bandit Approach

Mobile Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning: A Scalable Framework

Joint User Scheduling and Beam Selection in Mmwave Networks Based on Multi-Agent Reinforcement Learning