Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

Delay-Aware Routing in Low Duty-Cycle Wireless Sensor Networks

Energy Efficient Link-Delay Aware Routing in Wireless Sensor Networks

Group-Based Neighbor Discovery in Low-Duty-Cycle Mobile Sensor Networks

A Density-Based Energy-Effective Routing For Sensor Networks

A General Framework for Adjustable Neighbor Discovery in Wireless Sensor Networks

Dynamic Routing Algorithm for Priority Guarantee in Low Duty-Cycled Wireless Sensor Networks

Poster: Selective Reference Mechanism for Neighbor Discovery in Low-Duty-cycle Wireless Sensor Networks

Stair Scheduling for Data Collection in Wireless Sensor Networks

A Two-Hop Based Real-Time Routing Protocol for Wireless Sensor Networks

Delay-Bounded Data Forwarding in Low-Duty-Cycle Sensor Networks

Enhancing Real-Time Delivery in Wireless Sensor Networks with Two-Hop Information

Two-Hop Neighborhood Information-Based Real-Time Routing Design for Sensor Networks

Adaptive duty cycle control–based opportunistic routing scheme to reduce delay in cyber physical systems

Energy-aware Routing for Delay-Sensitive Underwater Wireless Sensor Networks.

A Low-Delay Energy-Efficient Decision Strategy in Duty-Cycled Wireless Sensor Networks

Achieving Lower Delay with Energy Efficiency in Extremely Low-Duty-Cycle and Unreliable WSN

An Energy Efficient Data Transmission Approach for Low-Duty-cycle Wireless Sensor Networks

Designing energy efficient routing scheme with delay constraint forwireless sensor networks

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Research of Speedup Data Collection in Unreliable Low-Duty-Cycle WSN

Time-Sensitive Utility-Based Single-Copy Routing in Low-Duty-Cycle Wireless Sensor Networks