Abstract:The dynamic topology, narrow transmission bandwidth, and limited energy of sensor nodes in mobile underwater acoustic sensor networks (UASNs) pose challenges to design an efficient and robust network for underwater communications. In this paper, we propose a novel machine learning-based clustering and routing scheme, named energy-efficient clustering and cooperative routing based on improved K-means and Q-learning (ECRKQ), to reduce and balance energy consumption among sensor nodes in a mobile UASN and improve the bandwidth utilization. In the cluster head (CH) selection stage, ECRKQ modifies the K-means algorithm to dynamically select a CH based on the residual energy of the node and the distance from the node to the centroid in a cluster. In the clustering stage, ECRKQ adopts the Q-learning algorithm by incorporating the residual energy of the CH, the energy consumption of data transmission from the node to the CH, and the energy consumption of the data transmission from the CH to the base station into the Q-value function. In the data transmission stage, ECRKQ applies the dynamic coded cooperation (DCC) transmission to improve the bandwidth utilization and the robustness of the underwater communications. In the DCC transmission, cooperative nodes are also dynamically selected based on the residual energy and the energy consumption of transmitting a packet to their destinations. In the simulation, we apply the ocean current drifting model to emulate the position variation of nodes caused by ocean currents in a mobile UASN. The simulation results show that the proposed ECRKQ scheme can achieve more balanced energy consumption among sensor nodes in a mobile UASN than that of the existing scheme.

An Unequal Clustering Method Based on Particle Swarm Optimization in Underwater Acoustic Sensor Networks

A Centralized Control-Based Clustering Scheme for Energy Efficiency in Underwater Acoustic Sensor Networks

A Q-Learning-Based Hierarchical Routing Protocol with Unequal Clustering for Underwater Acoustic Sensor Networks

Game-Theory-Based Clustering Scheme for Energy Balancing in Underwater Acoustic Sensor Networks

K-means ++ and Reinforcement Learning-Based Clustering Method to Achieve Energy Efficiency in Underwater Acoustic Sensor Networks

Unequal Clustering Algorithm for WSNs Using Particle Swarm Optimization

A cluster?head election algorithm optimization in clustered underwater acoustic sensor networks

Energy-Balanced Clustering Protocols for Underwater Sensor Networks

An Energy Optimization Clustering Scheme for Multi-Hop Underwater Acoustic Cooperative Sensor Networks

Optimization of the cluster-head selection algorithm of an energy-based underwater acoustic sensor network

How to Perform Energy-Balanced Underwater Data Collection in AUV-Aided UASNs: A Social Welfare-Based Node Clustering Approach

A low complexity clustering optimization algorithm for underwater sensor networks

A Robust Clustering Architecture for Medium Scale Underwater Acoustic Sensor Networks

Node Energy Consumption Balanced Multi-Hop Transmission for Underwater Acoustic Sensor Networks Based on Clustering Algorithm.

Non-Uniform Clustering Algorithm for UWSNs Based on Energy Equalization

Energy-balanced Routing Protocol with Nonuniform Clustering for Underwater Acoustic Sensors Networks

ECRKQ: Machine Learning-Based Energy-Efficient Clustering and Cooperative Routing for Mobile Underwater Acoustic Sensor Networks

A Cluster-Head Selection Scheme for Underwater Acoustic Sensor Networks

An Innovative Cluster Routing Method for Performance Enhancement in Underwater Acoustic Sensor Networks

A Novel Multi-Hop Clustering Routing Algorithm Based on Particle Swarm Optimization for Wireless Sensors Networks

A New Clustering Algorithm Using Adaptive Discrete Particle Swarm Optimization in Wireless Sensor Network