Abstract:Wireless sensor networks (WSN) have been widely used in urban network system and networked monitoring system, which provide easy connectivity and high physical data rate. Considering the battery-limited property of sensor nodes, recently, energy harvesting (EH) technology is introduced into WSN, which can alleviate traditional WSN problems (energy consumption, energy equilibrium, transmission efficiency, etc.). Current EH-WSN routing algorithms generally use the continuous energy harvesting mode, therefore, how to design an efficient routing algorithm for discrete energy harvesting mode and ensure the overall energy balance and conservation is still a great challenge and needs to be solved. Especially, under the mobile environment, the impact of route stability needs to be considered, which makes the design more complicated. To address the above problems, we propose a learning automata (LA) theory based stable and energy-efficient routing algorithm for discrete EH-mobile WSN (DEH-LA-SERA, for short). Firstly, we construct a multi-factors measurement model for sensor nodes, which contains node stability model, energy ratio function, expected harvesting energy model (using Markov decision process method) and direction judgement model. On this basis, we derive the node weighted value, i.e., selecting probability, which can be used to determine whether a node can be chosen as relay node. Secondly, with the help of LA theory, we construct a feedback mechanism to adjust the optimal path. With this solution, we can ensure the overall energy balance and conservation while holding the stability of selected path. As demonstrated in simulation experiments, our algorithm, DEH-LA-SERA, achieved the best performance in route survival time, energy consumption, energy balance and acceptable performance in end-to-end delay and packets delivery ratio.

Towards Energy Efficient LPWANs through Learning-based Multi-hop Routing

Learning Optimal Routing for the Uplink in LPWANs Using Similarity-enhanced epsilon-greedy

Exploiting Rateless Codes and Cross-layer Optimization for Low-power Wide-area Networks

LP-MAB: Improving the Energy Efficiency of LoRaWAN Using a Reinforcement-Learning-Based Adaptive Configuration Algorithm

Energy Efficient Routing for Multi-modal Underwater Wireless Sensor Networks

Energy-aware Routing for Delay-Sensitive Underwater Wireless Sensor Networks.

Multiple agent based reinforcement learning for energy efficient routing in WSN

An Energy Efficient Routing Protocol based on Reinforcement Learning for WSN

Optimizing Energy Efficiency of LoRaWAN-based Wireless Underground Sensor Networks: A Multi-Agent Reinforcement Learning Approach

Adaptive Multi-Path Routing Based on an Improved Leapfrog Algorithm.

An Energy-adaptive Multiple Paths Routing Approach for Wireless Sensor Networks.

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Optimizing Routing Protocol Design for Long-Range Distributed Multi-Hop Networks

A energy efficiency optimization routing processing method for Linear Wireless Sensor Networks

MLRS-RL: an Energy-Efficient Multilevel Routing Strategy Based on Reinforcement Learning in Multimodal UWSNs

Matching-Driven Deep Reinforcement Learning for Energy-Efficient Transmission Parameter Allocation in Multi-Gateway LoRa Networks

A Learning Automata Based Stable and Energy-Efficient Routing Algorithm for Discrete Energy Harvesting Mobile Wireless Sensor Network

Enhancement in Optimal Resource-Based Data Transmission Over LPWAN Using a Deep Adaptive Reinforcement Learning Model Aided by Novel Remora With Lotus Effect Optimization Algorithm

A novel reinforcement learning based routing algorithm for energy management in networks

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

An Energy-Balanced Multi-Hop Transmission Routing Algorithm For Linear Wireless Sensor Networks