Path Planning for the Dynamic UAV-Aided Wireless Systems using Monte Carlo Tree Search

Yuwen Qian,Kexin Sheng,Chuan Ma,Jun Li,Ming Ding,Mahbub Hassan
DOI: https://doi.org/10.1109/tvt.2022.3160746
IF: 6.8
2022-01-01
IEEE Transactions on Vehicular Technology
Abstract:For UAV-aided wireless systems, online path planning attracts much attention recently. To better adapt to the real-time dynamic environment, for the first time, we propose a Monte Carlo Tree Search (MCTS)-based path planning scheme. In details, we consider a single UAV acts as a mobile server to provide computation tasks offloading services for a set of mobile users on the ground, where the movement of ground users follows a Random Way Point model. Our model aims at maximizing the average throughput under energy consumption and user fairness constraints, and the proposed time-saving MCTS algorithm can further improve the performance. Simulation results show that the proposed algorithm achieves a larger average throughput and a faster convergence performance compared with the baseline algorithms of Q-learning and Deep Q-Network.
telecommunications,engineering, electrical & electronic,transportation science & technology
What problem does this paper attempt to address?