Multi-Agent Reinforcement Learning for Dynamic Spectrum Access.

Huijuan Jiang,Tianyu Wang,Shaowei Wang

DOI: https://doi.org/10.1109/icc.2019.8761786

2019-01-01

Abstract:Cognitive radio is an efficient spectrum sharing mechanism to solve the contradiction between spectrum shortage and spectrum underutility, where secondary users (SUs) are allowed to access the spectrum licensed to primary users (PUs) in an opportunistic manner. In cognitive radio networks with multiple access points (APs), due to the information exchange cost and system flexibility, APs may not cooperate with each other and there usually does not exist a central controller in practice. We propose a distributed user association scheme based on multi-agent reinforcement learning to achieve load balancing for cognitive radio networks with multiple independent APs. In our proposed scheme, APs execute reinforcement learning process independently to derive optimal policies on user association. In each iteration, APs make decisions on choosing SUs for association and then SUs choose the optimal AP for association based on the offers of all APs, the behaviors of APs and SUs is modeled as a dynamic matching game. Simulation results show that the proposed multi-agent reinforcement learning approach can highly improve the system performance with excellent robustness, compared to the conventional max-SINR method.