Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

MLRS-RL: an Energy-Efficient Multilevel Routing Strategy Based on Reinforcement Learning in Multimodal UWSNs

An Efficient Routing Access Method Based on Multi-Agent Reinforcement Learning in UWSNs

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

Energy Efficient Routing for Multi-modal Underwater Wireless Sensor Networks

Reinforcement Learning-Based Opportunistic Routing Protocol for Underwater Acoustic Sensor Networks

An Efficient Cooperative Routing with ML based Energy Efficiency Model for Distributed Underwater WSN Electricity Meter Warning System

A Multi-Agent Reinforcement Learning Routing Protocol for Underwater Optical Sensor Networks

Energy-aware Routing for Delay-Sensitive Underwater Wireless Sensor Networks.

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

A Multi-Hop Reverse Localization Scheme for Underwater Wireless Sensor Networks

Reinforcement Learning-Based Opportunistic Routing Protocol using Depth Information for Energy-efficient Underwater Wireless Sensor Networks

Optimizing Energy Efficiency of LoRaWAN-based Wireless Underground Sensor Networks: A Multi-Agent Reinforcement Learning Approach

A Q-Learning-Based Hierarchical Routing Protocol with Unequal Clustering for Underwater Acoustic Sensor Networks

QMCR: A Q-learning-based Multi-Hop Cooperative Routing Protocol for Underwater Acoustic Sensor Networks

A novel reinforcement learning based routing algorithm for energy management in networks

An end-to-end sensor scheduling method based on D3QN for underwater passive tracking in UWSNs

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Multi-Agent Reinforcement Learning-Based Routing Protocol for Underwater Wireless Sensor Networks with Value of Information

Multiple agent based reinforcement learning for energy efficient routing in WSN

Q-Learning Based Routing Optimization Algorithm for Underwater Sensor Networks

Reinforcement-Learning-Based Relay Mobility and Power Allocation for Underwater Sensor Networks Against Jamming