Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

A Self-Adaptive Middleware for Efficient Routing in Distributed Sensor Networks

Energy Efficient Link-Delay Aware Routing in Wireless Sensor Networks

A Self-Adaptive and Energy Efficient Routing Approach for Wireless Sensor Network

Node-Disjoint Parallel Multi-Path Routing in Wireless Sensor Networks

A Parallel Multi-Path Algorithm for Adaptive Routing in Wireless Sensor Networks

A Two-Hop Based Real-Time Routing Protocol for Wireless Sensor Networks

Energy Efficient Routing for Multi-modal Underwater Wireless Sensor Networks

Distributed Rate Control, Routing, and Energy Management in Dynamic Rechargeable Sensor Networks

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Adaptive Swarm-Based Routing in Communication Networks.

A distributed middleware for self-configurable wireless sensor networks

A distributed routing-aware power control scheme for underwater wireless sensor networks

An Adaptive Real-Time Routing Scheme for Wireless Sensor Networks

An Adaptive and Multi-Service Routing Protocol for Wireless Sensor Networks

Taming the underlying challenges of reliable multihop routing in sensor networks

An Energy-Aware Routing Scheme with Node Relay Willingness in Wireless Sensor Networks

A Faster Routing Scheme for Stationary Wireless Sensor Networks - A Hybrid Approach

An adaptive load-aware routing algorithm for multi-interface wireless mesh networks

A optimized distributed multicast routing protocol for wireless sensor network

Reinforcement Learning-Based Adaptive Stateless Routing for Ambient Backscatter Wireless Sensor Networks

Energy-efficient geographic routing in asynchronous wireless sensor networks