Abstract:The Fifth Generation (5G) mobile networks use millimeter waves (mmWaves) to offer gigabit data rates. However, unlike microwaves, mmWave links are prone to user and topographic dynamics. They easily get blocked and end up forming irregular cell patterns for 5G. This in turn causes too early, too late, or wrong handoffs (HOs). To mitigate HO challenges, sustain connectivity, and avert unnecessary HO, we propose an HO scheme based on a jump Markov linear system (JMLS) and deep reinforcement learning (DRL). JMLS is widely known to account for abrupt changes in system dynamics. DRL likewise emerges as an artificial intelligence technique for learning highly dimensional and time-varying behaviors. We combine the two techniques to account for time-varying, abrupt, and irregular changes in mmWave link behavior by predicting likely deterioration patterns of target links. The prediction is optimized by meta training techniques that also reduce training sample size. Thus, the JMLS–DRL platform formulates intelligent and versatile HO policies for 5G. When compared to a signal and interference noise ratio (SINR) and DRL-based HO scheme, our HO scheme becomes more reliable in selecting reliable target links. In particular, our proposed scheme is able to reduce wasteful HO to less than 5% within 200 training episodes compared to the DRL-based HO scheme that needs more than 200 training episodes to get to less than 5%. It supports longer dew time between HOs and high sum rates by ably averting unnecessary HOs with almost half the HOs compared to a DRL-based HO scheme.

Reinforcement Learning-based Joint Handover and Beam Tracking in Millimeter-wave Networks

Learning-based Load Balancing Handover in Mobile Millimeter Wave Networks

Handover Based on Receive Beamforming in High Mobility Cellular Communication Networks

A novel handover scheme for millimeter wave network: An approach of integrating reinforcement learning and optimization

Gradual beamforming and soft handover in high mobility cellular communication networks

Machine-Learning Beam Tracking and Weight Optimization for mmWave Multi-UAV Links

Tracking mm-Wave Channel Dynamics: Fast Beam Training Strategies under Mobility

Millimeter-Wave Networking in the Sky: A Machine Learning and Mean Field Game Approach for Joint Beamforming and Beam-Steering

Joint Beam Management and SLAM for mmWave Communication Systems

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Reinforcement Learning Based Handoff for Millimeter Wave Heterogeneous Cellular Networks.

Reinforcement Learning for Optimized Beam Training in Multi-Hop Terahertz Communications

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Beam Alignment and Tracking for Millimeter Wave Communications via Bandit Learning

Fast MIMO Beamforming via Deep Reinforcement Learning for High Mobility mmWave Connectivity

Machine Learning-Based Handovers for Sub-6 GHz and mmWave Integrated Vehicular Networks

Millimetre-Wave Beam Tracking: an Intelligent Machine Learning and Kalman Filter Fusion Technology

Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning

Robust Adaptive Beam Tracking for Mobile Millimetre Wave Communications

A Deep Learning Approach to Location- and Orientation-aided 3D Beam Selection for mmWave Communications