Abstract:In the evolution of railway mobile communications from Long Term Evolution for Railway (LTE-R) to the future 5th Generation Wireless System (5G), the rapid increase in the number of low-power base station nodes along the railway has brought more frequent handovers. The current handover parameter selection mechanism often relies on the on-site measured results in a limited number of discrete scenarios. It cannot deal with the continuous changing characteristics of the high-speed railway mobile communication environment, which leads to a serious lack of accuracy, adaptability and intelligence. This article hopes to construct a parameter-adaptive handover mechanism suitable for 5G in the high-speed railway dedicated LTE-R communication system. The mechanism first uses the interaction of Temporal-Difference(TD)-learning-based reinforced agents to obtain high-speed railway handover performance and network performance in different combinations of speeds and handover parameters, and continuously updates the accumulated rewards used to target optimization, obtaining a Discrete TD value cube with closely related handover performance. Further, based on the Discrete TD value cube, we use the approximation function method for the completion of "continuous" situation of handover parameter selection, and construct a continuous TD value cube and the corresponding performance cubes. Our experimental results prove that TD learning agents with function approximation can accurately estimate and predict the handover performance and network performance of state combinations with different speeds and handover parameters, and further show that the handover parameter adaptation mechanism based on the Inference ability can find the optimal handover parameters to improve the handover performance and network performance.

Can Online Learning Increase the Reliability of Extreme Mobility Management?

Can Online Learning Make Extreme Mobility More Reliable?

Bandit Policies for Reliable Cellular Network Handovers in Extreme Mobility

Mobility Management in 5G and Beyond: A Novel Smart Handover with Adaptive Time-to-Trigger and Hysteresis Margin

Optimal Handover Policy for Mmwave Cellular Networks: A Multi-Armed Bandit Approach

A Mobility Load Balancing Algorithm Based on Handover Optimization in LTE Network

Parameter Adaptation and Situation Awareness of LTE-R Handover for High-Speed Railway Communication

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

Spatial and Temporal Contextual Multi-Armed Bandit Handovers in Ultra-Dense mmWave Cellular Networks

Rethinking Mobile Data Offloading for LTE in Unlicensed Spectrum

A Distributed User Association Method for LTE-U by Enabling Q-Learning in Minority Game.

Learning-based Load Balancing Handover in Mobile Millimeter Wave Networks

Movement-Based Reliable Mobility Management for Beyond 5G Cellular Networks.

A CoMP soft handover scheme for LTE systems in high speed railway

Exploiting Mobility Patterns for Inter-Technology Handover in Mobile Environments

A Deep Reinforcement Learning-based Approach for Adaptive Handover Protocols in Mobile Networks

Dynamic Fuzzy Q-learning for Handover Parameters Optimization in 5G Multi-Tier Networks

Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning

A Non-stochastic Learning Approach to Energy Efficient Mobility Management

A Parameter Optimization Method for LTE-R Handover Based on Reinforcement Learning