A Dynamic Priority Packet Scheduling for UAV Assisted AoI-Aware Network: A Deep Reinforcement Learning Approach

Xiaoying Fu,Jiansong Miao,Yushun Yao,Tao Zhang,Shanling Bai,Lan Yi
DOI: https://doi.org/10.1109/vtc2024-spring62846.2024.10683283
2024-01-01
Abstract:When ground base stations are not available in the aftermath of a disaster, unmanned aerial vehicle (UAV) acting as flying relay is a promising option. The UAVs with limited energy as flying relays allow for wider data coverage and more stable data transmission. However, with the changes of ground devices topology and channel, it is challenging to consider quality of service (QoS) and the age of information (AoI) in UAV communication under the energy constraint. In this paper, we propose a dynamic priority packet scheduling for UAV assisted AoI-aware network whose utility is maximized subject to QoS to get the best tradeoff of the energy consumption and the weighted AoI. Specifically, the dynamics of devices are characterized by Gauss-Markov mobility model. Dynamic priority is affected by devices' movement, channel changes and others. We optimize the trajectory of the UAV and the scheduling scheme of the packets by the Dueling Double Deep Q Network (D3QN) algorithm. Simulations show that the scheme significantly improves the utility of the system compared to the benchmarks.
What problem does this paper attempt to address?