Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

Predictable Energy Aware Routing Based on Dynamic Game Theory in Wireless Sensor Networks.

Energy Efficient Link-Delay Aware Routing in Wireless Sensor Networks

A Density-Based Energy-Effective Routing For Sensor Networks

Power-Efficient Routing Mechanism in Sensor Networks based on Node-Density

Virtual force-field based energy efficient geo-routing in wireless sensor network

Game Theoretic Energy Balance Routing In Wireless Sensor Networks

Game Theory-based Energy Balance Routing with Incomplete Information in Wireless Sensor Networks

Game Theoretic Distributed Energy Control in Sensor Networks

Data Gathering Optimization by Dynamic Sensing and Routing in Rechargeable Sensor Networks

Energy-aware Routing for Delay-Sensitive Underwater Wireless Sensor Networks.

Game-Based Dynamic Clustering Routing Strategy for Mobile Wireless Sensor Networks

Clustering Routing Algorithm Using Game-Theoretic Techniques For Wsns

A Self-Adaptive and Energy Efficient Routing Approach for Wireless Sensor Network

Energy Aware Efficient Geographic Routing in Lossy Wireless Sensor Networks with Environmental Energy Supply

An Energy-Balanced Routing Protocol for a Wireless Sensor Network

Energy and throughput aware adequate routing for wireless sensor networks using integrated game theory method

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Energy-efficient Geographic Routing in Environmentally Powered Wireless Sensor Networks

Energy-efficient geographic routing in asynchronous wireless sensor networks

Design Principles and Improvement of Cost Function Based Energy Aware Routing Algorithms for Wireless Sensor Networks

Energy Efficient Routing Algorithm with Mobile Sink Support for Wireless Sensor Networks