Abstract:Satellite communication systems are increasingly facing serious environmental challenges such as malicious jamming, monitoring, and intercepting. As a current development of artificial intelligence, intelligent jammers with learning ability can effectively perceive the surrounding spectrum environment to dynamically change their jamming strategies. As a result, the current mainstream satellite communication anti-jamming technology based on wide interval high-speed frequency hopping is unable to deal with this problem effectively. In this work, we focus on anti-jamming problems in the satellite communication domain, and reformulate the power allocation problem under two kinds of confrontation scenarios as one-shot and repeated games model. Specifically, for the problem of multi-channel power allocation under a one-shot confrontation scenario, we firstly model the problem of allocating limited power resource between communication parties and a jammer on multi-channel based on a BG (Blotto Game) model. Secondly, a DO-SINR (Double Oracle-Signal to Interference plus Noise Ratio) algorithm is designed to approximate the Nash equilibrium of the game between two parties. Experiments show that the DO-SINR algorithm can effectively obtain the approximate Nash equilibrium of the game. For the problem of multi-channel power allocation under a repeated confrontation scenario, we firstly transform the problem into an online shortest path problem with a graph structure to make the problem solving process more intuitive, and then design the Exp3-U (Exp3-Uniform) algorithm which utilizes the graph structure to solve the multi-channel power allocation problem. Experiments show that our algorithm can minimize the expected regret of communication parties during online confrontation, while maintaining good operating efficiency. The two power allocation problems constructed in this paper are common problem formed in confrontation scenarios. Our research and analysis can simulate some actual confrontation scenarios of the satellite communication power allocation, which can be used to improve the adaptability of satellite communication systems in complex environments.

Joint resource allocation in underwater acoustic communication networks: A game-based hierarchical adversarial multiplayer multiarmed bandit algorithm.

Game-based Hierarchical Multi-Armed Bandit Learning Algorithm for Joint Channel and Power Allocation in Underwater Acoustic Communication Networks

MAB-based Two-Tier Learning Algorithms for Joint Channel and Power Allocation in Stochastic Underwater Acoustic Communication Networks

Joint Multiple Resources Allocation for Underwater Acoustic Cooperative Communication in Time-Varying IoUT Systems: A Double Closed-Loop Adversarial Bandit Approach

Jamming-Resilient Algorithm For Underwater Cognitive Acoustic Networks

Power Allocation Based on Multi-Agent Deep Deterministic Policy Gradient for Underwater Acoustic Communication Networks

Relay Selection for Underwater Acoustic Sensor Networks: A Multi-User Multi-Armed Bandit Formulation.

Auction Game Based Optical and Acoustic Communication Scheduling Mechanism for Underwater Scenario.

Robust joint multiple resources allocation algorithm for cooperative underwater acoustic communication networks

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Anti-Jamming Colonel Blotto Game for Underwater Acoustic Backscatter Communication

Auction-Based Combinatorial Multi-Armed Bandit Mechanisms with Strategic Arms

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

Joint Relay Selection and Power Allocation Algorithm with Trust Parameter in an Underwater Cognitive Acoustic Cooperative System.

Exploiting Propagation Delay in Underwater Acoustic Communication Networks via Deep Reinforcement Learning

Combination of Auction Theory and Multi-Armed Bandits: Model, Algorithm, and Application

Multi-agent deep reinforcement learning based multiple access for underwater cognitive acoustic sensor networks

Multi-Agent Reinforcement Learning for Joint Cooperative Spectrum Sensing and Channel Access in Cognitive UAV Networks

Equilibrium Approximating and Online Learning for Anti-Jamming Game of Satellite Communication Power Allocation

Learning-Based Multi-Domain Anti-Jamming Communication with Unknown Information

Multi-Agent Bandit Learning through Heterogeneous Action Erasure Channels