Abstract:The underwater wireless sensor networks (UWSNs) receive extensive concern and become common tools for underwater target passive tracking. To address the energy constraints of battery-powered sensors in UWSNs, efficient sensor scheduling methods that balance tracking accuracy and energy consumption are essential. Considering the common sensor scheduling methods facing with the problems of strong environment dependence and lack flexibility, an end-to-end sensor scheduling algorithm based on the deep reinforcement learning is proposed. In particular, we formulate the sensors' scheduling strategy in UWSNs as Markov decision process (MDP) within the context of reinforcement learning. Moreover, a Dueling double deep Q network (D3QN) is introduced to solve the MDP in a scalable and model free manner for a suitable sensor scheduling policy of UWSNs and the prioritized experience replaybuffer (PER) is utilized to improve the performance of D3QN. In addition, to ensure practical applicability, a mock data method is introduced to train the algorithm without relying on accurate trajectory information of Non-cooperative target. Thus, an end-to-end sensor scheduling method can be built. Experimental results demonstrate the effectiveness and superiority of the proposed algorithm. In large-scale UWSNs for underwater passive tracking, the proposed method achieves a minimum of 20% improvement in tracking accuracy while reducing the system's energy consumption by 10% compared to the traditional method.

Adaptive Sensor Scheduling for Target Tracking in Underwater Wireless Sensor Networks

An Artificial Measurements-Based Adaptive Filter for Energy-Efficient Target Tracking Via Underwater Wireless Sensor Networks

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

A Multi-Node Cooperative Bearing-Only Target Passive Tracking Algorithm Via UWSNs

An end-to-end sensor scheduling method based on D3QN for underwater passive tracking in UWSNs

Energy-efficient Localization and Target Tracking Via Underwater Mobile Sensor Networks

An Adaptive Sampling Algorithm for Target Tracking in Underwater Wireless Sensor Networks

A Novel Sensor Scheduling Algorithm Based on Deep Reinforcement Learning for Bearing-Only Target Tracking in UWSNs

Energy-efficient Adaptive Sensor Scheduling for Target Tracking in Wireless Sensor Networks

Energy-Efficient Sensor Deployment Strategy for Optimal Coverage of Underwater Events Inspired by Krill Herd

Distributed Target Tracking in UWSNs under Stochastic Node Communication Scheme

Non-Myopic Energy Allocation for Target Tracking in Energy Harvesting UWSNs

Distributed Target Tracking with Fading Channels over Underwater Acoustic Sensor Networks

Tracking a Duty-Cycled Autonomous Underwater Vehicle by Underwater Wireless Sensor Networks

Local Node Selection for Target Tracking Based on Underwater Wireless Sensor Networks

Mutual-information based weighted fusion for target tracking in underwater wireless sensor networks

Energy-Efficient Distributed Adaptive Multisensor Scheduling for Target Tracking in Wireless Sensor Networks.

Mutual-information basedweighted fusion for target tracking in underwater wireless sensor networks

Feature-Aided Passive Tracking of Noncooperative Multiple Targets Based on the Underwater Sensor Networks

Adaptive Sensor Activation for Target Tracking in Wireless Sensor Networks.

Node Selection For Target Tracking In Uwsns Under Measurement Origin Uncertainty