Abstract:Cognitive radio (CR) users are expected to be uncoordinated users that opportunistically seek the spectrum resource from primary users (PUs) in a competitive way. In most existing works, however, CR users are required to share the interference channel information and power strategies to conduct the game with pricing mechanisms that incur the frequent exchange of information. The requirement of significant communication overheads among CR users impedes fully distributed solutions for the deployment of CR networks, which is a challenging problem in the research communities. In this paper, a robust distributed power control algorithm is designed with low implementation complexity for CR networks through reinforcement learning, which does not require the interference channel and power strategy information among CR users (and from CR users to PUs). To the best of our knowledge, this research provides the solution for the first time for the incomplete-information power control game in CR networks. During the repeated game, CR users can control their power strategies by observing the interference from the feedback signals of PUs and transmission rates obtained in the previous step. This procedure allows achieving high spectrum efficiency while conforming to the interference constraint of PUs. This constrained repeated stochastic game with learning automaton is proved to be asymptotically equivalence to the traditional game with complete information. The properties of existence, diagonal concavity and uniqueness for the game are studied. A Bush-Mosteller reinforcement learning procedure is designed for the power control algorithm, and the properties of convergence and learning rate of the algorithm are analyzed. The performance of the learning-based power control algorithm is thoroughly investigated with simulation results, which demonstrates the effectiveness of the proposed algorithm in solving variety of practical CR network problems for real-world applications.

Relay selection and discrete power control in cognitive relay networks using learning automata

Relay Selection and Discrete Power Control for Cognitive Relay Networks via Potential Game

A spectrum access game in bidirectional cognitive relay networks

Learning to Be Energy-Efficient in Cooperative Networks

A Game Theory Approach for Power Control and Relay Selection in Cooperative Communication Networks with Asymmetric Information.

Relay Management in Energy-Aware Cooperative Ad Hoc Networks: A Perspective of Stochastic Game

Energy-efficient power allocation in cognitive sensor networks: A game theoretic approach

Multi-leader Multi-follower Game Power Control with Utility Learning for Cooperative Relay Networks over Interference Channels

A Two-Layered Game Approach Based Relay’s Source Selection and Power Control for Wireless Cooperative Networks

Novel Deep Reinforcement Learning‐based Delay‐constrained Buffer‐aided Relay Selection in Cognitive Cooperative Networks

Optimal Relay Selection Strategy in Cognitive Cooperative Relaying Network

Distributed Relay Selection and Channel Choice in Cognitive Radio Network

A Game-Theoretic Approach for Distributed Power Control in Interference Relay Channels

Relay selection and power allocation for cooperative networks using stackelberg game

Distributed relay selection over multi-source and multi-relay wireless cooperative networks with selfish nodes

Reinforcement Learning for Repeated Power Control Game in Cognitive Radio Networks

Self-Organized Relay Selection for Cooperative Transmission in Vehicular Ad-Hoc Networks

Secure relay selection based on learning with negative externality in wireless networks

Energy-Efficient Distributed Relay and Power Control in Cognitive Radio Cooperative Communications.

Adaptive Power Control Algorithm in Cognitive Radio Based on Game Theory.

Optimal Power Control for Wireless Cooperative Relay Networks: a Cooperative Game Theoretic Approach.