Abstract:This paper studies an unmanned aerial vehicle (UAV)-assisted wireless powered IoT network, where a rotary-wing UAV adopts fly-hover-communicate protocol to successively visit IoT devices in demand. During the hovering periods, the UAV works on full-duplex mode to simultaneously collect data from the target device and charge other devices within its coverage. Practical propulsion power consumption model and non-linear energy harvesting model are taken into account. We formulate a multi-objective optimization problem to jointly optimize three objectives: maximization of sum data rate, maximization of total harvested energy and minimization of UAV's energy consumption over a particular mission period. These three objectives are in conflict with each other partly and weight parameters are given to describe associated importance. Since IoT devices keep gathering information from the physical surrounding environment and their requirements to upload data change dynamically, online path planning of the UAV is required. In this paper, we apply deep reinforcement learning algorithm to achieve online decision. An extended deep deterministic policy gradient (DDPG) algorithm is proposed to learn control policies of UAV over multiple objectives. While training, the agent learns to produce optimal policies under given weights conditions on the basis of achieving timely data collection according to the requirement priority and avoiding devices' data overflow. The verification results show that the proposed MODDPG (multi-objective DDPG) algorithm achieves joint optimization of three objectives and optimal policies can be adjusted according to weight parameters among optimization objectives.

Optimizing the Charging Mobility of WPT-Enabled UAV to Enhance the Stability of Solar-Powered LoRaWAN IoT

Energy-Efficient Data Collection and Wireless Power Transfer Using A MIMO Full-Duplex UAV

Joint Wireless Charging and Data Collection for UAV-Enabled Internet of Things Network

Aerial Energy Provisioning for Massive Energy-Constrained IoT by UAVs

Wireless Powering Internet of Things with UAVs: Challenges and Opportunities

UAV-enabled data acquisition scheme with directional wireless energy transfer for Internet of Things

Energy Maximization for Ground Nodes in UAV-Enabled Wireless Power Transfer Systems

Joint Dynamic Task Offloading and Resource Scheduling for WPT Enabled Space-Air-Ground Power Internet of Things

Energy Efficiency Optimization of UAV-Assisted Wireless Powered Systems for Dependable Data Collections in Internet of Things

Hardware Impairment-Aware Data Collection and Wireless Power Transfer Using a MIMO Full-Duplex UAV

Trajectory and Resource Optimization in OFDM-Based UAV-Powered IoT Network

UAV-Enabled Wireless Power Transfer With Base Station Charging and UAV Power Consumption

An Energy Efficient Cooperation Design For Multi-Uavs Enabled Wireless Powered Communication Networks

Efficient Energy Supply Using Mobile Charger for Solar-Powered Wireless Sensor Networks

Rechargeable Multi-UAV Aided Seamless Coverage for QoS-Guaranteed IoT Networks

An OFDM Based Interference Reducing Scheme with Trajectory and Resource Optimization for UAV-powered IoT Networks

UAV-Based Solution for Extending the Lifetime of IoT Devices: Efficiency, Design and Sustainability

UAV-assisted wireless powered Internet of Things: Joint trajectory optimization and resource allocation

Energy Maximization for Wireless Powered Communication Enabled IoT Devices With NOMA Underlaying Solar Powered UAV Using Federated Reinforcement Learning for 6G Networks

Multi-Objective Optimization for UAV-Assisted Wireless Powered IoT Networks Based on Extended DDPG Algorithm

Proximal Policy Optimization Algorithm for Enhancing Energy Harvesting in UAV-Assisted Communications with RIS