Abstract:In maritime data collection scenarios, achieving the rapid delivery of data from buoy sensor nodes to the shipboard station is a challenging issue. Utilizing unmanned aerial vehicles (UAVs) technology to facilitate the transfer of data from buoy sensor nodes, it becomes feasible to significantly reduce the latency generated in the transmission process. Therefore, we introduce a UAV-assisted maritime Internet of Things (MIoT) data collection mechanism based on relay cooperation. In this mechanism, through relay transmissions among UAVs, it avoids UAVs located distant from the shipboard station from having to traverse extensive distances in order to offload data to the shipboard station. Based on this, we propose a deep reinforcement learning-based cooperative data collection (DCDC) scheme. In this scheme, firstly, we select the convergence node in charge of forwarding the data from buoy sensor nodes to the passing UAVs. Next, to achieve dynamic adaptation of the task areas for UAVs, we propose an adaptive partition algorithm based on virtual moving points. Subsequently, to establish relay transmission links between UAVs, we present a routing algorithm based on matching game theory. Finally, to reduce time costs in delivering collected data to the shipboard station, we utilize a deep reinforcement learning algorithm based on multi-agent deep deterministic policy gradient (MADDPG) plan the flight paths of UAVs. Additionally, we introduce virtual waypoints in the path planning algorithm, which enables that paired UAVs can high-efficiently perform data forwarding through encounter opportunities. Extensive simulation experiments have demonstrated that the proposed scheme outperforms existing schemes in terms of system Age of Information (AoI).

Timely Data Collection for UAV-based IoT networks: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Deep Reinforcement Learning for Efficient Data Collection in UAV-Aided Internet of Things

Meta-Reinforcement Learning for Timely and Energy-efficient Data Collection in Solar-powered UAV-assisted IoT Networks

Research on the UAV-aided Data Collection and Trajectory Design Based on the Deep Reinforcement Learning

UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

Multi-Task Transfer Deep Reinforcement Learning for Timely Data Collection in Rechargeable-UAV-aided IoT Networks

DRLR: A Deep Reinforcement Learning based Recruitment Scheme for Massive Data Collections in 6G-based IoT networks

UAV-Enabled Data Collection for IoT Networks via Rainbow Learning

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

UAV-Assisted Status Updates

DRL-UTPS: DRL-Based Trajectory Planning for Unmanned Aerial Vehicles for Data Collection in Dynamic IoT Network

Application of Deep Reinforcement Learning in UAVs: A Review

Cooperative Data Collection with Multiple UAVs for Information Freshness in the Internet of Things

UAV Resource Cooperation Based on Reinforcement Learning.

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

Cooperative Data Collection for UAV-Assisted Maritime IoT Based on Deep Reinforcement Learning

Joint Speed Control and Energy Replenishment Optimization for UAV-assisted IoT Data Collection with Deep Reinforcement Transfer Learning

Hierarchical Deep Reinforcement Learning for Backscattering Data Collection With Multiple UAVs