Energy-AOI-Aware UAV-Assisted Data Collection: A Multi-Agent Deep Reinforcement Learning-Based Trajectory Optimization

Liangtian Wan,Kun Zhang,Lu Sun,Gang Xu,Xianpeng Wang
DOI: https://doi.org/10.1109/icct59356.2023.10419500
2023-01-01
Abstract:With the development of Internet of Things (IoT) technology, sensor networks are widely used for data collection in various IoT scenarios. Traditional sensors use multi-hop communication to transmit data back to the data center, which can lead to excessive energy consumption in some nodes and cause the collapse of sensor networks. Solving the data transmission problem in sensor networks has become a critical issue. In recent years, unmanned aerial vehicles (UAVs) capable of hovering have been increasingly applied in military and civilian fields, such as smart logistics, edge computing, and wireless power transfer (WPT). UAVs, with their strong controllability and high mobility, can effectively perform the task of data transmission in sensor networks. In the task of UAV -assisted sensor data collection, UAVs can establish communication connections with ground sensors through small communication devices and act as mobile aggregation nodes to collect data from the ground wireless sensor network. To achieve energy balance among sensor network nodes as much as possible while ensuring service quality based on information age, we propose a combinatorial optimization problem. Ultimately, we solve the combinatorial optimization problem by optimizing the trajectory of UAV flight. As the problem is a mixed-integer non-convex optimization which is difficult to solve, we propose a UAV swarm-based sensor trajectory planning algorithm using multi-agent reinforcement learning. Simulation results show that the proposed algorithm has a better effect than baseline approaches on optimization objective.
What problem does this paper attempt to address?