Abstract:Reinforcement Learning (RL) has been employed to assign transmission parameters to all sub-carriers in a set frequency band for anti-jamming Orthogonal Frequency Division Multiplexing (OFDM) systems. However, prior works often overlooked the influence of wireless environment fading and convergence issues stemming from overly large parameter sets. To address these challenges, an anti-jamming scheme was proposed based on the Non-Contiguous Orthogonal Frequency Division Multiplexing (NC-OFDM) communication system integrated with reinforcement learning. First, all sub-carriers were divided into sub-bands, and a Finite State Markov Sub-bands (FSMS) model was established to describe the time-varying fading characteristics of each sub-band by combining Adaptive Modulation and Coding (AMC) technology. To mitigate instability due to the fading channel, a joint sub-band and modulation anti-jamming decision scheme was adopted, enabling the transmitter to select the optimal sub-band and transmission rate. Ultimately, this decision-making process was modeled as a Markov Decision Process (MDP), and an Upper Confidence Bound based Q-learning (UCB-Q) anti-jamming algorithm was proposed for obtaining the joint sub-band and transmission rate selection strategies. Simulation results indicate that the proposed algorithm demonstrates enhanced speed and superior average throughput. Additionally, the algorithm showcases the same commendable anti-jamming performance in scenarios with time-varying dynamic jamming.

Dynamic Spectrum Anti-Jamming in Broadband Communications: A Hierarchical Deep Reinforcement Learning Approach

A hidden anti-jamming method based on deep reinforcement learning

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

Joint Sub-Band and Transmission Rate Selection for Anti-Jamming Non-Contiguous Orthogonal Frequency Division Multiplexing System: An Upper Confidence Bound Based Reinforcement Learning Approach

QoS and Jamming-Aware Wireless Networking Using Deep Reinforcement Learning

Intelligent Dynamic Spectrum Anti-Jamming Communications: A Deep Reinforcement Learning Perspective

Fast Reinforcement Learning for Anti-jamming Communications

A Hierarchical Learning Approach to Anti-Jamming Channel Selection Strategies

“Advancing Secretly by an Unknown Path”: A Reinforcement Learning-based Hidden Strategy for Combating Intelligent Reactive Jammer

Dynamic Spectrum Anti-Jamming Access With Fast Convergence: A Labeled Deep Reinforcement Learning Approach

An Intelligent Strategy Decision Method for Collaborative Jamming Based On Hierarchical Multi-Agent Reinforcement Learning

Primary-User-Friendly Dynamic Spectrum Anti-Jamming Access: A GAN-Enhanced Deep Reinforcement Learning Approach

Learning-Based Multi-Domain Anti-Jamming Communication with Unknown Information

Jamming-Resilient Algorithm For Underwater Cognitive Acoustic Networks

A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks

Intelligent Anti-Jamming Communication for Wireless Sensor Networks: A Multi-Agent Reinforcement Learning Approach

Two-Dimensional Antijamming Mobile Communication Based on Reinforcement Learning

Intelligent Anti-jamming based on Deep Reinforcement Learning and Transfer Learning

A Game-Theoretic Learning Approach for Anti-Jamming Dynamic Spectrum Access in Dense Wireless Networks

Generalization of Deep Reinforcement Learning for Jammer-Resilient Frequency and Power Allocation

Reinforcement Learning based Anti-jamming Frequency Hopping Strategies Design for Cognitive Radar