Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

Energy-Efficient Routing and Rate Allocation for Delay Tolerant Networks

Energy Efficient Link-Delay Aware Routing in Wireless Sensor Networks

An adaptive multiple spray-and-wait routing algorithm based on social circles in delay tolerant networks

Distance-Based Energy-Efficient Opportunistic Forwarding in Mobile Delay Tolerant Networks

Energy Estimation Based Routing Protocol for Delay Tolerant Network

Performance Evaluation Of Routing Schemes For The Energy-Constrained Dtn With Selfish Nodes

Online Routing and Scheduling in Bandwidth-Limited Delay Tolerant Networks.

Opportunistic Forwarding in Energy Harvesting Mobile Delay Tolerant Networks

A DTN Routing and Buffer Management Strategy for Message Delivery Delay Optimization

Optimal Relaying in Heterogeneous Delay Tolerant Networks

DelQue: A Socially Aware Delegation Query Scheme in Delay-Tolerant Networks

Optimization of Energy Consumption in Delay-Tolerant Networks

Exploiting DTN Routing Algorithms Under Resource Constraints.

An Optimal Relaying Scheme for Delay-Tolerant Networks with Heterogeneous Mobile Nodes

Erasure-coding based routing for opportunistic networks.

An Intelligent Approach to Energy Efficient Transportation and QoS Routing

A Security and Efficient Routing Scheme with Misbehavior Detection in Delay-Tolerant Networks

Robust Energy-Aware Routing With Uncertain Traffic Demands

A moving energy-based routing in DTNs with speed heterogeneity

Performance Evaluation of Routing Schemes for Energy-Constrained Delay/Fault-Tolerant Mobile Sensor Network

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach