Abstract:Reinforcement Learning (RL) has been employed to assign transmission parameters to all sub-carriers in a set frequency band for anti-jamming Orthogonal Frequency Division Multiplexing (OFDM) systems. However, prior works often overlooked the influence of wireless environment fading and convergence issues stemming from overly large parameter sets. To address these challenges, an anti-jamming scheme was proposed based on the Non-Contiguous Orthogonal Frequency Division Multiplexing (NC-OFDM) communication system integrated with reinforcement learning. First, all sub-carriers were divided into sub-bands, and a Finite State Markov Sub-bands (FSMS) model was established to describe the time-varying fading characteristics of each sub-band by combining Adaptive Modulation and Coding (AMC) technology. To mitigate instability due to the fading channel, a joint sub-band and modulation anti-jamming decision scheme was adopted, enabling the transmitter to select the optimal sub-band and transmission rate. Ultimately, this decision-making process was modeled as a Markov Decision Process (MDP), and an Upper Confidence Bound based Q-learning (UCB-Q) anti-jamming algorithm was proposed for obtaining the joint sub-band and transmission rate selection strategies. Simulation results indicate that the proposed algorithm demonstrates enhanced speed and superior average throughput. Additionally, the algorithm showcases the same commendable anti-jamming performance in scenarios with time-varying dynamic jamming.

Optimization Of Resource Allocation In Multi-Cell Ofdm Systems: A Distributed Reinforcement Learning Approach

Energy-Efficient Resource Allocation in Single-Cell OFDMA Systems: Multi-Objective Approach

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

Adaptive subcarrier and bit allocation in OFDMA systems supporting heterogeneous services

Intelligent Resource Allocation for IRS-Enhanced OFDM Communication Systems: A Hybrid Deep Reinforcement Learning Approach

Optimal Resource Allocation Via Machine Learning in Coordinated Downlink Multi-Cell OFDM Networks under Imperfect CSI

An Efficient Radio Resource Management Strategy for Adaptive OFDM Cellular Systems

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Power Control and Resource Allocation for Multi-Cell OFDM Networks with Load Coupling

Joint Optimization of User Association, Subchannel Allocation, and Power Allocation in Multi-cell Multi-association OFDMA Heterogeneous Networks

Joint Resource Management with Distributed Uplink Power Control in Full-Duplex OFDMA Networks

Utility-Based Resource Allocation in a Multi-Cell OFDMA System with Base Station Cooperation

Multi-user cognitive OFDM with adaptive sub-carrier and power allocation

Cooperative Resource Allocation in OFDM-based Multicell Cognitive Radio Systems

Distributed Coordinated Beamforming Based on Multi-Agent Reinforcement Learning in Multicell MISO Systems

Resource Allocation Based on Integer Programming and Game Theory in Uplink Multi-Cell Cooperative OFDMA Systems

Subcarrier allocation based on correlated equilibrium in multi-cell OFDMA systems

Resource Allocation Based on Game Theory for Multi-Cell OFDMA Systems

Adaptive Block-Level Resource Allocation in OFDMA Networks

Joint Sub-Band and Transmission Rate Selection for Anti-Jamming Non-Contiguous Orthogonal Frequency Division Multiplexing System: An Upper Confidence Bound Based Reinforcement Learning Approach

Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks