Abstract:Cognitive networks (CNs) are one of the key enablers for the Internet of Things (IoT), where CNs will play an important role in the future Internet in several application scenarios, such as healthcare, agriculture, environment monitoring, and smart metering. However, the current low packet transmission efficiency of IoT faces a problem of the crowded spectrum for the rapidly increasing popularities of various wireless applications. Hence, the IoT that uses the advantages of cognitive technology, namely the cognitive radio-based IoT (CIoT), is a promising solution for IoT applications. A major challenge in CIoT is the packet transmission efficiency using CNs. Therefore, a new Q-learning-based transmission scheduling mechanism using deep learning for the CIoT is proposed to solve the problem of how to achieve the appropriate strategy to transmit packets of different buffers through multiple channels to maximize the system throughput. A Markov decision process-based model is formulated to describe the state transformation of the system. A relay is used to transmit packets to the sink for the other nodes. To maximize the system utility in different system states, the reinforcement learning method, i.e., the Q learning algorithm, is introduced to help the relay to find the optimal strategy. In addition, the stacked auto-encoders deep learning model is used to establish the mapping between the state and the action to accelerate the solution of the problem. Finally, the experimental results demonstrate that the new action selection method can converge after a certain number of iterations. Compared with other algorithms, the proposed method can better transmit packets with less power consumption and packet loss.

An Actor-Critic Deep Reinforcement Learning Approach for Transmission Scheduling in Cognitive Internet of Things Systems

Energy Efficient Transmission in Underlay CR-NOMA Networks Enabled by Reinforcement Learning

A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Artificial Intelligence Inspired Transmission Scheduling in Cognitive Vehicular Communications and Networks.

Deep Reinforcement Learning for Multi-Functional RIS-Aided Over-the-Air Federated Learning in Internet of Robotic Things

Deep Reinforcement Learning Optimal Transmission Algorithm for Cognitive Internet of Things with RF Energy Harvesting

Deep-Reinforcement-Learning-Based Energy-Efficient Resource Management for Social and Cognitive Internet of Things

Adaptive transmission scheduling over fading channels for energy-efficient cognitive radio networks by reinforcement learning

Scheduling Real-Time Wireless Traffic: A Network-Aided Offline Reinforcement Learning Approach

Intelligent Resource Management Based on Reinforcement Learning for Ultra-Reliable and Low-Latency IoV Communication Networks

AoI-Aware Resource Scheduling for Industrial IoT with Deep Reinforcement Learning

Multi Actor-Critic PPO: A Novel Reinforcement Learning Method for Intelligent Task and Charging Scheduling in Electric Freight Vehicles Management.

Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks.

Fairness-Aware Intelligent Multi-BD Scheduling in Symbiotic Radio Networks Using Soft Actor-Critic

Dynamic Service Function Chain Orchestration for NFV/MEC-Enabled IoT Networks: A Deep Reinforcement Learning Approach

802.11ax Uplink Scheduling Algorithm Based onReinforcement Learning

Dynamic Charging Scheme Problem with Actor–Critic Reinforcement Learning

Deep-Reinforcement-Learning-Based Scheduling with Contiguous Resource Allocation for Next-Generation Cellular Systems

Real-Time Optimization of Urban Rail Transit Train Scheduling Via Advantage Actor–Critic Deep Reinforcement Learning

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing