Abstract:Wireless sensor networks (WSNs) have undergone rapid development but still suffer from energy shortage issues. Meanwhile, existing energy-efficient routing approaches lack a cross-layer cooperation mechanism and cannot offer intelligent decision-making capabilities for resource-constrained nodes. In this paper, we design an intelligent routing algorithm with adaptive duty cycling for application in software-defined WSNs (SDWSNs) to maximize the network lifetime and data transmission reliability subject to a long-term data queue stability constraint. In particular, we introduce Lyapunov optimization to decouple the multistage routing optimization problem into per-frame deterministic problems with delay guarantee. To optimize the routing algorithm and adaptively adjust the duty-cycling mechanism, we propose a cooperative deep reinforcement learning (CDRL) model. Moreover, we develop a centralized training and distributed execution framework to decouple the model training and inference processes, which provides the capability of intelligent routing decision-making for resource-constrained nodes with low computational complexity. In addition, we design a new hybrid routing metric and a unique feature construction and extraction scheme to capture fine-grained information from our hybrid routing metric. The proposed CDRL algorithm adopts a cooperative and iterative model optimization strategy to achieve highly reliable data transmission and optimal long-term network performance. Simulation results demonstrate the effectiveness of the proposed algorithm in terms of network lifetime, packet delivery ratio, and statistical delay performance under various scenarios compared to the EBR-RL, EA-AGG, and QLRP algorithms.

Age-Energy Efficiency in WPCNs: A Deep Reinforcement Learning Approach

Maximizing Age-Energy Efficiency in Wireless Powered Industrial IoE Networks: A Dual-Layer DQN-Based Approach

Security Enhancement for Deep Reinforcement Learning-Based Strategy in Energy-Efficient Wireless Sensor Networks

Long-Term Throughput Maximization in Wireless Powered Communication Networks: A Multi-Task DRL Approach

Energy Management in Energy Harvesting Wireless Networks: A Reinforcement Learning Framework

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Reinforcement Learning (RL)-Based Energy Efficient Resource Allocation for Energy Harvesting-Powered Wireless Body Area Network

Deep Reinforcement Learning-Assisted Energy Harvesting Wireless Networks

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

Deep Reinforcement Learning Based Energy Efficient Resource Allocation for Wireless Powered Edge Computing Network

Deep Reinforcement Learning-Based Energy Consumption Optimization for Peer-to-Peer (P2P) Communication in Wireless Sensor Networks

Deep Reinforcement Learning Aided Intelligent Access Control in Energy Harvesting Based WLAN

Deep Reinforcement Learning Based Energy Efficient Underwater Acoustic Communications

Deep Reinforcement Learning for Energy Saving in Radio Access Network

Deep Learning for Wireless Networked Systems: a joint Estimation-Control-Scheduling Approach

Reinforcement Learning Based Multi-Access Control with Energy Harvesting

Deep Reinforcement Learning Enabled Energy-Efficient Resource Allocation in Energy Harvesting Aided V2X Communication.

Optimizing Sleep Schedules for Energy-Efficient Agricultural Wireless Sensor Networks Using Deep Reinforcement Learning

Power-Aware Traffic Engineering Via Deep Reinforcement Learning

Deep Reinforcement Learning Empowers Wireless Powered Mobile Edge Computing: Towards Energy-Aware Online Offloading

Deep Reinforcement Learning Method for Energy Efficient Resource Allocation in Next Generation Wireless Networks.