Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Na Lin,Lu Bai,Ammar Hawbani,Yunchong Guan,Chaojin Mao,Zhi Liu,Liang Zhao
DOI: https://doi.org/10.1109/jiot.2024.3356725
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:In wireless networks, meeting the performance requirements of all tasks solely with Internet of Things (IoT) devices is challenging due to their limited computational power and battery capacity. Given their flexibility and mobility, the application of unmanned aerial vehicles (UAVs) in the context of mobile edge computing (MEC) has garnered significant interest within the sector. However, UAVs also face constraints in terms of resources like storage and computational power. Therefore, it is vital to develop effective UAV assistance solutions to provide long-term demands of in-network services. The dynamic scheduling and computation offloading of UAVs is the subject of this paper. Specifically, we propose a deep deterministic policy gradient algorithm based on a greedy strategy (DDPGG) to jointly optimize dynamic scheduling, device association, and task allocation of UAVs, with the goal of minimizing the weighted sum of total system energy consumption and time delay. The problem is formulated as a nonlinear programming problem involving mixed integers. The simulation results demonstrate that the DDPGG algorithm we have proposed exhibits a higher level of performance in comparison to its competitors.
computer science, information systems,telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?