Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

A Delay-Driven Cross-Layer Routing Approach

Delay-oriented Routing Approach for Backbones with the Interference

A Fast Adaptive Routing Algorithm Based on Delay

An adaptive multiple spray-and-wait routing algorithm based on social circles in delay tolerant networks

Dynamic service-level-agreement aware shared-path protection in WDM mesh networks

Dynamic Shared Path Protection Algorithm in WDM Mesh Networks under Service Level Agreement Constraints

Dynamic Load Distribution with Hop-by-hop Forwarding Based on Max-Min One-Way Delay

Delay-Aware Routing in Low Duty-Cycle Wireless Sensor Networks

Cloud Service Routing in WDM Networks with Awareness on Delay and Link Failure Probability

A Cross-Layer Congestion Control Strategy in Wireless Sensor Network

Cross-Layer Routing Protocol Based on Channel Quality for Underwater Acoustic Communication Networks

A Centralized Cross-Layer Protocol for Joint Power Control, Link Scheduling, and Routing in UWSNs

Delay-aware cross-layer design for device-to-device communications in future cellular systems

Delay-Aware Resource Control and Routing in Multihop Wireless Networks

MiniDelay: Multi-Strategy Timing-Aware Layer Assignment for Advanced Technology Nodes

Delay-Aware Cross-Layer Design for Network Utility Maximization in Multi-hop Networks

DAWN: A Density Adaptive Routing Algorithm for Vehicular Delay Tolerant Sensor Networks.

Minimum Delay Routing for Connected and Autonomous Vehicles Communications

Algorithm for Post Global Routing RLC Crosstalk Avoidance

Congestion Avoidance Transmission Mechanism Based on Two-Dimensional Forwarding.

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach