Abstract:In the industrial environment, the data transmission of Wireless Sensor Networks (WSNs) usually has strict deadline requirements. Improving the reliability and real-time performance of data transmission has become one of the critical issues in WSNs research. One of the main methods to improve the network performance of WSNs is to schedule the transmission process. An effective scheduling algorithm can meet the requirements of a strict industrial environment for network performance, which is of great research significance. Aiming at the problem of concurrent data transmission in WSNs, a real-time data transmission scheduling algorithm based on deep Q-learning is proposed. The algorithm comprehensively considers the influence of the remaining deadline, remaining hops, and unassigned time-slot nodes in the data transmission process, defines the reward function and action selection strategy of Q-learning, and guides the system state information transfer process. At the same time, deep learning and Q-learning are combined to solve the problem of disaster maintenance caused by the large scale of the system state. A multi-layer Stacked Auto Encoder (SAE) network model establishes the state-action mapping relationship, and the Q-learning algorithm updates it. Finally, according to the trained SAE network model, the data transmission scheduling strategy of the system in different states is obtained. The network performance of the proposed data transmission scheduling algorithm is analyzed and evaluated by simulation experiments. The simulation results show that compared with the commonly used heuristic algorithms, the proposed algorithm improves real-time performance and can better meet the data transmission requirements of high reliability and real-time WSNs.

Data-Based Distributed Sensor Scheduling for Multiple Linear Systems With <inline-formula><tex-math notation="LaTeX">$H_\infty$</tex-math></inline-formula> Performance Preservation

Fuzzy-Model-Based &Lt;inline-Formula><tex-math Notation="latex">$h_\infty$</tex-Math></inline-for Mula> Control for Networked Singularly Perturbed Systems: the Asynchronous Weighted Try-Once-Discard Protocol Case

MINIMUM LATENCY LINK SCHEDULING FOR ARBITRARY DIRECTED ACYCLIC NETWORKS UNDER PRECEDENCE AND SINR CONSTRAINTS

Distributed Wireless Link Scheduling in the SINR Model.

Optimal Sensor Scheduling for Two Linear Dynamical Systems under Limited Resources in Sensor Networks

Joint Energy Replenishment and Operation Scheduling in Wireless Rechargeable Sensor Networks.

A Novel Sensor Scheduling Algorithm Based on Deep Reinforcement Learning for Bearing-Only Target Tracking in UWSNs

Distributed H ∞ State Estimator Design for Time-Delay Periodic Systems Over Scheduling Sensor Networks

An Energy-Balanced Data Gathering Algorithm for Linear Wireless Sensor Networks.

Sensor Data Scheduling for Linear Quadratic Gaussian Control with Full State Feedback

Scheduling to Minimize Control Cost in Multi-loop Wireless Networked Control with Imperfect Sensors

Sensor Scheduling for Distributed Filtering under Limited Communication Resources

Distributed H ∞ filtering for repeated scalar nonlinear systems with random packet losses in sensor networks

Optimal Node Scheduling for the Lifetime Maximization of Two-Tier Wireless Sensor Networks

Distributed Real-Time Data Aggregation Scheduling In Duty-Cycled Multi-Hop Sensor Networks

Sensor scheduling with limited communication energy and bandwidth

Optimal Scheduling of Multiple Sensors Over Lossy and Bandwidth Limited Channels

Real-Time Data Transmission Scheduling Algorithm for Wireless Sensor Networks Based on Deep Q-Learning

Power Scheduling for Kalman Filtering over Lossy Wireless Sensor Networks

Distributed $H_\infty$ State and Parameter Estimation over Wireless Sensor Networks under Energy Constraints

Power Scheduling of Kalman Filtering in Wireless Sensor Networks with Data Packet Drops