Abstract:In the industrial environment, the data transmission of Wireless Sensor Networks (WSNs) usually has strict deadline requirements. Improving the reliability and real-time performance of data transmission has become one of the critical issues in WSNs research. One of the main methods to improve the network performance of WSNs is to schedule the transmission process. An effective scheduling algorithm can meet the requirements of a strict industrial environment for network performance, which is of great research significance. Aiming at the problem of concurrent data transmission in WSNs, a real-time data transmission scheduling algorithm based on deep Q-learning is proposed. The algorithm comprehensively considers the influence of the remaining deadline, remaining hops, and unassigned time-slot nodes in the data transmission process, defines the reward function and action selection strategy of Q-learning, and guides the system state information transfer process. At the same time, deep learning and Q-learning are combined to solve the problem of disaster maintenance caused by the large scale of the system state. A multi-layer Stacked Auto Encoder (SAE) network model establishes the state-action mapping relationship, and the Q-learning algorithm updates it. Finally, according to the trained SAE network model, the data transmission scheduling strategy of the system in different states is obtained. The network performance of the proposed data transmission scheduling algorithm is analyzed and evaluated by simulation experiments. The simulation results show that compared with the commonly used heuristic algorithms, the proposed algorithm improves real-time performance and can better meet the data transmission requirements of high reliability and real-time WSNs.

A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things

Artificial Intelligence Inspired Transmission Scheduling in Cognitive Vehicular Communications and Networks.

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

Deep-Reinforcement-Learning-Based Energy-Efficient Resource Management for Social and Cognitive Internet of Things

Real-Time Data Transmission Scheduling Algorithm for Wireless Sensor Networks Based on Deep Q-Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Reinforcement Learning For Joint Channel Selection And Power Allocation In Cognitive Internet Of Things

Q-Learning-Based Dynamic Spectrum Access in Cognitive Industrial Internet of Things

An Actor-Critic Deep Reinforcement Learning Approach for Transmission Scheduling in Cognitive Internet of Things Systems

Qoe Driven Resource Allocation In Massive Iot: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Optimal Transmission Algorithm for Cognitive Internet of Things with RF Energy Harvesting

A Novel Transmission Scheduling Based on Deep Reinforcement Learning in Software-Defined Maritime Communication Networks

Q-learning based Cognitive Wireless Network access Mechanism

Deep Reinforcement Learning-based Distributed Dynamic Spectrum Access in Multi-User Multi-channel Cognitive Radio Internet of Things Networks

Q-Learning-Based Spectrum Access for Multimedia Transmission Over Cognitive Radio Networks

A Novel QoS-enabled Load Scheduling Algorithm Based on Reinforcement Learning in Software-Defined Energy Internet

Intelligent Transmission Scheduling Based on Deep Reinforcement Learning

Dynamic Channel Selection and Transmission Scheduling for Cognitive Radio Networks.

Joint Spectrum Sensing and Packet Error Rate Optimization in Cognitive IoT.

Deep Reinforcement Learning for Multiple Access in Dynamic IoT Networks Using Bi-GRU

Multi-relay Cooperative Mechanism with Q-Learning in Cognitive Radio Multimedia Sensor Networks