Abstract:As an extension and novel category of the Internet of Things (IoT), the Internet of Underwater Things (IoUT) attracts growing interest in sensing and exploiting ocean. Underwater Sensor Networks (UWSNs) are the existing application to support the concept of IoUT but faced with many challenges in information acquisition as well. To tackle these issues, this paper proposes an autonomous underwater vehicle (AUV) assisted hierarchical information acquisition system composed of a marine stationary sensor layer and an AUV motion layer. Different from the most existing data-gathering schemes that ignored the energy management of underwater sensor nodes and the angle control in AUV operation, this work designs an energy-aware clustering protocol based on the improved K-Means algorithm (ECBIK) to achieve energy efficiency of sensor nodes and proposes a novel Ant Colony (ACO) algorithm integrating with Markov Reward Process (R-ACO) to optimize the distance and angle in AUV path planning. Specifically, in the sensor layer, we first calculate the accurate number of clusters according to the Elbow method, and then introduce a cluster head dynamic conversion mechanism by considering energy load and node survival rate. In the AUV motion layer, we establish a reliable AUV trajectory model to quantify the angle change during its operation. Meanwhile, we apply far-sighted feature of MRP to path optimization. Finally, simulation results validate the performance of our designed algorithms. Compared with the traditional clustering methods of K-Means and LEACH-L, the node survival rates of the proposed ECBIK are increased by 26% and 129.1% respectively. And in the aspect of path planning, the distance and angle under R-ACO are reduced by 4% and 18% respectively compared with ACO.

Multi-Objective-Optimization Multi-AUV Assisted Data Collection Framework for IoUT Based on Offline Reinforcement Learning

Learning an End-To-End Policy for AUV Control Within Just Forty Minutes Using Parallel Simulation

An AUV-Assisted Data Gathering Scheme Based on Deep Reinforcement Learning for IoUT

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Adaptive Data Collection and Offloading in Multi-UAV-Assisted Maritime IoT Systems: A Deep Reinforcement Learning Approach

Design of Heterogeneous Multi-AUV IoUT: Architecture, Key Technologies and Applications

Multi-AUV Pursuit-Evasion Game in the Internet of Underwater Things: an Efficient Training Framework Via Offline Reinforcement Learning

AUV-Aided Optical-Acoustic Hybrid Data Collection Based on Deep Reinforcement Learning

Dynamic Data Collection of AUV Based on Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning Framework Strategized by Unmanned Aerial Vehicles for Multi-Vessel Full Communication Connection

Environment- and Energy-Aware AUV-Assisted Data Collection for the Internet of Underwater Things

A Hierarchical Information Acquisition System for AUV Assisted Internet of Underwater Things.

Efficient Data Collection Scheme for Multi-Modal Underwater Sensor Networks Based on Deep Reinforcement Learning

AUV-Aided Localization for Internet of Underwater Things: A Reinforcement-Learning-Based Method.

An On-Board Control Scheme for Consumer-Level Autonomous Underwater Vehicle in the Intelligent Cyber-Physical Transportation Systems

Enhancing Information Freshness: An AoI Optimized Markov Decision Process Dedicated In the Underwater Task

A Multi-AUV Collaborative Ocean Data Collection Method Based on LG-DQN and Data Value

Hybrid offline-online reinforcement learning for obstacle avoidance in autonomous underwater vehicles

An AUV-assisted Data Collection Scheme for UWSNs Based on Reinforcement Learning under the Influence of Ocean Current

Multi-Agent Reinforcement Learning Based Secure Searching and Data Collection in AUV Swarms.

Towards a Sustainable Internet-of-Underwater-Things based on AUVs, SWIPT, and Reinforcement Learning