Abstract:Designing efficient channel access schemes for wireless communications withoutany prior knowledge about the nature of environments has been a very challenging issue, espe cially when the channel states distribution of all spectrum resour ces could be entirely or partially stochastic and/or adversarial at different time and locations. In this paper, we propose an adaptive channel access algorithm for wireless communicat ions in unknown environments based on the theory of multi-armed bandits (MAB) problems. By automatically tuning two control parameters, i.e., learning rate and exploration probabili ty, our algorithms are capable of finding the optimal channel access strategies and achieving the almost optimal learning perfo rmance over time under our defined four typical regimes for general unknown environments, e.g., the stochastic regime where ch annels follow some unknown i.i.d. process, the adversarial re gime where all channels are suffered by adversarial jamming attack, the mixed stochastic and adversarial regime where a subset o f channels are attacked and the contaminated stochastic regi me where occasionally adversarial events contaminate the sto chastic channel process, etc. To reduce the implementation time and space complexity, we further develop an enhanced algorithmby exploiting the internal structure of the selection of channel access strategy. We conduct extensive simulations in all these reg imes to validate our theoretical analysis. The quantitative performance studies indicate the superior throughput gain and the flexibility of our algorithm in practice, which is resilient to both oblivious and adaptive jamming attacks with different intelligence and any attacking strength that ranges from no-attack to the full-attack of all spectrum resources.

Near-Optimal and Practical Jamming-Resistant Energy-Efficient Cognitive Radio Communications

Almost Optimal Energy-Efficient Cognitive Communications in Unknown Environments

Jamming-Resilient Algorithm For Underwater Cognitive Acoustic Networks

Jamming-Resilient Dynamic Spectrum Access for Cognitive Radio Networks

Anti-jamming communication in cognitive radio networks with unknown channel statistics

Energy-Efficient Cognitive Transmission with Imperfect Spectrum Sensing

Toward Optimal Adaptive Wireless Communications in Unknown Environments.

Robust Security Energy Efficiency Optimization for RIS-Aided Cell-Free Networks with Multiple Eavesdroppers.

Energy-Efficient Spectrum Sensing by Optimal Periodic Scheduling in Cognitive Radio Networks

M ay 2 01 5 Towards Optimal Adaptive Wireless Communications in Unknown Environments

Jamsa: A Utility Optimal Contextual Online Learning Framework for Anti-Jamming Wireless Scheduling under Reactive Jamming Attack

Secure Communication through Wireless-Powered Friendly Jamming: Jointly Online Optimization over Geography, Energy and Time

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

Energy-Efficient Channel Access and Data Offloading Against Dynamic Jamming Attacks.

Dynamic Spectrum Anti-Jamming Communications: Challenges and Opportunities

Spectrum allocation algorithm in cognitive ad-hoc networks with high energy efficiency

Anti-Jamming Resource Allocation for Integrated Sensing and Communications Based on Game-Guided Reinforcement Learning

Joint Transmit and Jamming Power Optimization for Secrecy in Energy Harvesting Networks: A Reinforcement Learning Approach

Enhancing Cognitive Radio Networks Performance with Game-Theoretic Anti-Jamming Strategies and Trial-Error Learning

Ambient Backscatter Communication-Assisted Cognitive Radios in the Presence of Jammer