Abstract:In the Energy-Harvesting (EH) Cognitive Internet of Things (EH-CIoT) network, due to the broadcast nature of wireless communication, the EH-CIoT network is susceptible to jamming attacks, which leads to a serious decrease in throughput. Therefore, this paper investigates an anti-jamming resource-allocation method, aiming to maximize the Long-Term Throughput (LTT) of the EH-CIoT network. Specifically, the resource-allocation problem is modeled as a Markov Decision Process (MDP) without prior knowledge. On this basis, this paper carefully designs a two-dimensional reward function that includes throughput and energy rewards. On the one hand, the Agent Base Station (ABS) intuitively evaluates the effectiveness of its actions through throughput rewards to maximize the LTT. On the other hand, considering the EH characteristics and battery capacity limitations, this paper proposes energy rewards to guide the ABS to reasonably allocate channels for Secondary Users (SUs) with insufficient power to harvest more energy for transmission, which can indirectly improve the LTT. In the case where the activity states of Primary Users (PUs), channel information and the jamming strategies of the jammer are not available in advance, this paper proposes a Linearly Weighted Deep Deterministic Policy Gradient (LWDDPG) algorithm to maximize the LTT. The LWDDPG is extended from DDPG to adapt to the design of the two-dimensional reward function, which enables the ABS to reasonably allocate transmission channels, continuous power and work modes to the SUs, and to let the SUs not only transmit on unjammed channels, but also harvest more RF energy to supplement the battery power. Finally, the simulation results demonstrate the validity and superiority of the proposed method compared with traditional methods under multiple jamming attacks.

Delay-Optimal Random Access for Massive Heterogeneous IoT Devices

Delay Optimal Random Access with Heterogeneous Device Capabilities in Energy Harvesting Networks Using Mean Field Game.

Delay-optimal Random Access in Large-Scale Energy Harvesting IoT Networks Based on Mean Field Game

Delay-Aware Massive Random Access for Machine-Type Communications Via Hierarchical Stochastic Learning

Delay-Optimal Computation Offloading in Large-Scale Multi-Access Edge Computing Using Mean Field Game

Reinforcement Learning for Improved Random Access in Delay-Constrained Heterogeneous Wireless Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Delay-Optimal Joint Processing in Computation-Constrained Fog Radio Access Networks

Utility Optimization for Multi-User Task Offloading in Mobile Ad Hoc Cloud: A Stochastic Game Approach.

Reinforcement Learning Random Access for Delay-Constrained Heterogeneous Wireless Networks: A Two-User Case

Mean Field-based Dynamic Backoff Optimization for MIMO-enabled Grant-Free NOMA in Massive IoT Networks

Opportunistic Forwarding in Energy Harvesting Mobile Delay Tolerant Networks

Resilient Massive Access for SAGIN: A Deep Reinforcement Learning Approach

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Achieving Maximum Urgency-Dependent Throughput in Random Access

Two-Stage Resource Allocation in Reconfigurable Intelligent Surface Assisted Hybrid Networks Via Multi-Player Bandits

Deep Reinforcement Learning Optimal Transmission Algorithm for Cognitive Internet of Things with RF Energy Harvesting

Joint Device Association, Resource Allocation and Computation Offloading in Ultra-Dense Multi-Device and Multi-Task IoT Networks

Anti-Jamming Resource-Allocation Method in the EH-CIoT Network through LWDDPG Algorithm

Resource Allocation in IoT Networks Using Wireless Power Transfer

Dynamic Resource Allocation and Task Offloading for NOMA-Enabled IoT Services in MEC