Abstract:The dynamic topology, narrow transmission bandwidth, and limited energy of sensor nodes in mobile underwater acoustic sensor networks (UASNs) pose challenges to design an efficient and robust network for underwater communications. In this paper, we propose a novel machine learning-based clustering and routing scheme, named energy-efficient clustering and cooperative routing based on improved K-means and Q-learning (ECRKQ), to reduce and balance energy consumption among sensor nodes in a mobile UASN and improve the bandwidth utilization. In the cluster head (CH) selection stage, ECRKQ modifies the K-means algorithm to dynamically select a CH based on the residual energy of the node and the distance from the node to the centroid in a cluster. In the clustering stage, ECRKQ adopts the Q-learning algorithm by incorporating the residual energy of the CH, the energy consumption of data transmission from the node to the CH, and the energy consumption of the data transmission from the CH to the base station into the Q-value function. In the data transmission stage, ECRKQ applies the dynamic coded cooperation (DCC) transmission to improve the bandwidth utilization and the robustness of the underwater communications. In the DCC transmission, cooperative nodes are also dynamically selected based on the residual energy and the energy consumption of transmitting a packet to their destinations. In the simulation, we apply the ocean current drifting model to emulate the position variation of nodes caused by ocean currents in a mobile UASN. The simulation results show that the proposed ECRKQ scheme can achieve more balanced energy consumption among sensor nodes in a mobile UASN than that of the existing scheme.

Achieving Fair-Effective Communications and Robustness in Underwater Acoustic Sensor Networks: A Semi-Cooperative Approach

Achieving Time-Sharing and Spatial-Reuse Underwater Wireless Sensor Networks with Communication Fairness: A Distributed Deep Multi-Agent Reinforcement Learning Approach

Joint Link Scheduling and Power Allocation in Imperfect and Energy-Constrained Underwater Wireless Sensor Networks

A Scalable and Fair Power Allocation Scheme Based on Deep Multi-Agent Reinforcement Learning in Underwater Wireless Sensor Networks

Time-based Adaptive Collision-Avoidance Real-Time MAC Protocol for Underwater Acoustic Sensor Networks

Delay and Queue Aware Adaptive Scheduling- Based MAC Protocol for Underwater Acoustic Sensor Networks

Secure Cooperation of Autonomous Mobile Sensors Using an Underwater Acoustic Network

Resource Allocation in Cooperative Cognitive Radio Networks Towards Secure Communications for Maritime Big Data Systems

A Deep MARL-Based Power-Management Strategy for Improving the Fair Reuse of UWSNs

UAV-Aided Cooperative Data Collection Scheme for Ocean Monitoring Networks.

Traffic Load-Aware Resource Management Strategy for Underwater Wireless Sensor Networks

Emergency Communication Schemes for Muliti-hop Underwater Acoustic Cooperartive Networks.

A load-adaptive fair access protocol for MAC in underwater acoustic sensor networks

ECRKQ: Machine Learning-Based Energy-Efficient Clustering and Cooperative Routing for Mobile Underwater Acoustic Sensor Networks

Cooperative Communication Based Protocols for Underwater Wireless Sensors Networks: A Review

A Multi-Channel Interference Based Source Location Privacy Protection Scheme in Underwater Acoustic Sensor Networks

Towards A Secure Medium Access Control Protocol For Cluster-Based Underwater Wireless Sensor Networks

Ecologically Friendly Full-Duplex Data Transmission Scheme for Underwater Acoustic Sensor Networks

Multimodal Acoustic-RF Adaptive Routing Protocols for Underwater Wireless Sensor Networks

Optimal Cooperative Relaying and Power Control for IoUT Networks with Reinforcement Learning

Joint Relay Selection and Power Allocation Algorithm with Trust Parameter in an Underwater Cognitive Acoustic Cooperative System.