Abstract:With the advancements in wireless sensor networks and the Internet of Underwater Things (IoUT), underwater acoustic sensor networks (UASNs) have attracted much attention, which has also been widely used in marine engineering exploration and disaster prevention. However, UASNs still face many challenges, including high propagation latency, limited bandwidth, high energy consumption, and unreliable transmission, influencing the good quality of service (QoS). In this paper, we propose a routing protocol based on the on-site architecture (SROA) for UASNs to improve network scalability and energy efficiency. The on-site architecture adopted by SROA is different from most architectures in that the data center is deployed underwater, which makes the sink nodes closer to the data source. A clustering method is introduced in SROA, which makes the network adapt to the changes in the network scale and avoid single-point failure. Moreover, the Q-learning algorithm is applied to seek optimal routing policies, in which the characteristics of underwater acoustic communication such as residual energy, end-to-end delay, and link quality are considered jointly when constructing the reward function. Furthermore, the reduction of packet retransmissions and collisions is advocated using a waiting mechanism developed from opportunistic routing (OR). The SROA realizes opportunistic routing to choose candidate nodes and coordinate packet forwarding among candidate nodes. The scalability of the proposed routing protocols is also analyzed by varying the network size and transmission range. According to the evaluation results, with the network scale ranging from 100 to 500, the SROA outperforms the existing routing protocols, extensively decreasing energy consumption and end-to-end delay.

ECRKQ: Machine Learning-Based Energy-Efficient Clustering and Cooperative Routing for Mobile Underwater Acoustic Sensor Networks

A Q-Learning-Based Hierarchical Routing Protocol with Unequal Clustering for Underwater Acoustic Sensor Networks

QMCR: A Q-learning-based Multi-Hop Cooperative Routing Protocol for Underwater Acoustic Sensor Networks

A Q-Learning and Data Priority-Based Routing Protocol with Dynamic Computing Cluster Head for Underwater Acoustic Sensor Networks

Energy-balanced Routing Protocol with Nonuniform Clustering for Underwater Acoustic Sensors Networks

K-means ++ and Reinforcement Learning-Based Clustering Method to Achieve Energy Efficiency in Underwater Acoustic Sensor Networks

An Energy Optimization Clustering Scheme for Multi-Hop Underwater Acoustic Cooperative Sensor Networks

A K-Means Clustered Routing Algorithm with Location and Energy Awareness for Underwater Wireless Sensor Networks

A Reliable Cluster-Based Opportunistic Routing Protocol for Underwater Wireless Sensor Networks

An Innovative Cluster Routing Method for Performance Enhancement in Underwater Acoustic Sensor Networks

How to Perform Energy-Balanced Underwater Data Collection in AUV-Aided UASNs: A Social Welfare-Based Node Clustering Approach

Adaptive Clustering Routing Protocol for Underwater Sensor Networks

Game-Theory-Based Clustering Scheme for Energy Balancing in Underwater Acoustic Sensor Networks

Energy-Efficient Mobile Data Collection Adopting Node Cooperation in an Underwater Acoustic Sensor Network

A Centralized Control-Based Clustering Scheme for Energy Efficiency in Underwater Acoustic Sensor Networks

Dcaro: Dynamic cluster formation and AUV-aided routing optimization for energy-efficient UASNs

An Energy Efficient Clustering Routing Protocol Based on Arithmetic Progression for Underwater Acoustic Sensor Networks

Node Energy Consumption Balanced Multi-Hop Transmission for Underwater Acoustic Sensor Networks Based on Clustering Algorithm.

A Cooperative Routing Protocol Based on Q-Learning for Underwater Optical-Acoustic Hybrid Wireless Sensor Networks

An On-Site-Based Opportunistic Routing Protocol for Scalable and Energy-Efficient Underwater Acoustic Sensor Networks

A novel reinforcement learning based routing algorithm for energy management in networks