Abstract:Compressive data gathering (CDG) is an adequate method to reduce the amount of data transmission, thereby decreasing energy expenditure for wireless sensor networks (WSNs). Sleep scheduling integrated with CDG can further promote energy efficiency. Most of existing sleep scheduling methods for CDG were formulated as centralized optimization problems which introduced many extra control message exchanges. Meanwhile, a few distributed methods usually adopted stochastic decision which could not adapt to variance in residual energy of nodes. A part of nodes were prone to prematurely run out of energy. In this paper, a reinforcement learning-based sleep scheduling algorithm for CDG (RLSSA-CDG) is proposed. Active nodes selection is modeled as a finite Markov decision process. The mode-free Q learning algorithm is used to search optimal decision strategies. Residual energy of nodes and sampling uniformity are considered into the reward function of the Q learning algorithm for load balance of energy consumption and accurate data reconstruction. It is a distributed algorithm that avoids large amounts of control message exchanges. Each node takes part in one step of the decision process. Thus, computation overhead for sensor nodes is affordable. Simulation experiments are carried out on the MATLAB platform to validate the effectiveness of the proposed RLSSA-CDG against the distributed random sleep scheduling algorithm for CDG (DSSA-CDG) and the original sparse-CDG algorithm without sleep scheduling. The simulation results indicate that the proposed RLSSA-CDG outperforms the two contrast algorithms in terms of energy consumption, network lifetime, and data recovery accuracy. The proposed RLSSA-CDG reduces energy consumption by 4.64% and 42.42%, respectively, compared to the DSSA-CDG and the original sparse-CDG, prolongs life span by 57.3%, and promotes data recovery accuracy by 84.7% compared to the DSSA-CDG.

Optimizing Sleep Schedules for Energy-Efficient Agricultural Wireless Sensor Networks Using Deep Reinforcement Learning

Distributed energy efficient scheduling in wireless sensor network for agriculture

Optimization of Energy-Efficient Algorithms for Real-Time Data Administering in Wireless Sensor Networks for Precision Agriculture

A reinforcement learning-based sleep scheduling algorithm for compressive data gathering in wireless sensor networks

Self-adaptive Sleep Scheduling for Wireless Sensor Networks

A balanced energy consumption sleep scheduling algorithm in wireless sensor networks

Diverse-Rate Based Dual Energy Aware Efficiency Task Scheduling Scheme in WSNs

A Novel Sensor Scheduling Algorithm Based on Deep Reinforcement Learning for Bearing-Only Target Tracking in UWSNs

An Optimized Sleeping Policy Integrating with Dynamic Voltage Scheduling in Wireless Sensor Network

Age-Energy Efficiency in WPCNs: A Deep Reinforcement Learning Approach

UAV-Assisted Sleep Scheduling Algorithm for Energy-Efficient Data Collection in Agricultural Internet of Things

Sensors Dynamic Energy Management in WSN

An energy-efficient SDN based sleep scheduling algorithm for WSNs

Optimal Sleep Scheduling for Energy-Efficient AoI Optimization in Industrial Internet of Things

Energy-efficient Local Wake-Up Scheduling in Wireless Sensor Networks

An Adaptive Sleep/Wakeup Scheduling Algorithm for Wireless Sensor Networks

Energy-Efficient Monitoring in Software Defined Wireless Sensor Networks Using Reinforcement Learning: A Prototype

Deep Reinforcement Learning-Based Energy Consumption Optimization for Peer-to-Peer (P2P) Communication in Wireless Sensor Networks

Sleep Scheduling in Energy Harvesting Wireless Body Area Networks

Energy Efficient Sleep Schedule with Service Coverage Guarantee in Wireless Sensor Networks

A Reinforcement Learning-Based Sleep Scheduling Algorithm for Desired Area Coverage in Solar-Powered Wireless Sensor Networks