Abstract:Compressive data gathering (CDG) is an adequate method to reduce the amount of data transmission, thereby decreasing energy expenditure for wireless sensor networks (WSNs). Sleep scheduling integrated with CDG can further promote energy efficiency. Most of existing sleep scheduling methods for CDG were formulated as centralized optimization problems which introduced many extra control message exchanges. Meanwhile, a few distributed methods usually adopted stochastic decision which could not adapt to variance in residual energy of nodes. A part of nodes were prone to prematurely run out of energy. In this paper, a reinforcement learning-based sleep scheduling algorithm for CDG (RLSSA-CDG) is proposed. Active nodes selection is modeled as a finite Markov decision process. The mode-free Q learning algorithm is used to search optimal decision strategies. Residual energy of nodes and sampling uniformity are considered into the reward function of the Q learning algorithm for load balance of energy consumption and accurate data reconstruction. It is a distributed algorithm that avoids large amounts of control message exchanges. Each node takes part in one step of the decision process. Thus, computation overhead for sensor nodes is affordable. Simulation experiments are carried out on the MATLAB platform to validate the effectiveness of the proposed RLSSA-CDG against the distributed random sleep scheduling algorithm for CDG (DSSA-CDG) and the original sparse-CDG algorithm without sleep scheduling. The simulation results indicate that the proposed RLSSA-CDG outperforms the two contrast algorithms in terms of energy consumption, network lifetime, and data recovery accuracy. The proposed RLSSA-CDG reduces energy consumption by 4.64% and 42.42%, respectively, compared to the DSSA-CDG and the original sparse-CDG, prolongs life span by 57.3%, and promotes data recovery accuracy by 84.7% compared to the DSSA-CDG.

Performance Analysis of Sleep Scheduling Schemes in Sensor Networks Using Stochastic Petri Net

Analysis of Random Sleep Scheme for Wireless Sensor Networks

Stair Scheduling for Data Collection in Wireless Sensor Networks

Stochastic Mobile Energy Replenishment and Adaptive Sensor Activation for Perpetual Wireless Rechargeable Sensor Networks

Distributed energy efficient scheduling in wireless sensor network for agriculture

Performance Analysis of Data Management in Sensor Data Storage Via Stochastic Petri Nets

An Energy-Efficient One-Shot Scheduling Algorithm for Wireless Sensor Networks

Energy-Efficient Capture of Stochastic Events under Periodic Network Coverage and Coordinated Sleep.

Practical Scheduling for Stochastic Event Capture in Energy Harvesting Sensor Networks

Energy-Efficient Capture Of Stochastic Events By Global- And Local-Periodic Network Coverage

BER-based Power Scheduling in Wireless Sensor Networks

Performance analysis of wireless opportunistic schedulers using stochastic Petri nets

A Mathematical Model for Energy-Efficient Coverage and Detection in Wireless Sensor Networks

ON THE DESIGN OF AN ENERGY-EFFICIENT DATA COLLECTION SCHEME FOR BODY AREA NANONETWORKS

A reinforcement learning-based sleep scheduling algorithm for compressive data gathering in wireless sensor networks

Distance Distribution-Based Modeling and Analysis for Pipelined-Forwarding Sensor Networks

An energy-efficient sleep scheduling mechanism with similarity measure for wireless sensor networks

Operation State Scheduling Towards Optimal Network Utility in RF-Powered Internet of Things.

Collaborative Distributed Scheduling Approaches for Wireless Sensor Network

Energy-Efficient Scheme For Ieee 802.15.4 Compliant Device

Energy-Efficient Wake-Up Scheduling for Data Collection and Aggregation