Abstract:As the scarce spectrum resource is becoming over-crowded, cognitive wireless mesh networks have great flexibility to improve the spectrum utilization by opportunistically accessing the licensed frequency bands. One of the critical challenges for realizing such network is how to adaptively allocate transmit powers and frequency resources among secondary users (SUs) of the licensed frequency bands while maintaining the quality-of-service (QoS) requirement of the primary users (PUs). In this paper, we consider the power control problem in the context of cognitive wireless mesh networks formed by a number of clusters under the total transmit power constraint by each SU as well as the mean-squared error (MSE) constraint by PUs. The problem is modeled as a non-cooperative game. A distributed iterative power allocation algorithm is designed to reach the Nash equilibrium (NE) between the coexisting interfered links. It offers an opportunity for SUs to negotiate the best use of power and frequency with each other. Furthermore, how to adaptively negotiate the transmission power level and spectrum usage among the SUs according to the changing networking environment is discussed. We present an intelligent policy based on reinforcement learning to acquire the stochastic behavior of PUs. Based on the learning approach, the SUs can adapt to the dynamics of the interference environment state and reach new NEs quickly through partially cooperative information sharing via a common control channel. Theoretical analysis and numerical results both show effectiveness of the intelligent policy.

Green transmit power assignment for cognitive radio networks by applying multi-agent Q-learning approach

Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach

Applying multi-agent Q-learning scheme in cognitive wireless mesh networks for green communications

Stochastic Power Adaptation with Multiagent Reinforcement Learning for Cognitive Wireless Mesh Networks

Power entangling and matching in cognitive wireless mesh networks by applying conjecture based multi-agent QQ-learning approach

Conjectural Variations in Multi-Agent Reinforcement Learning for Energy-Efficient Cognitive Wireless Mesh Networks.

Energy-efficient power allocation in cognitive sensor networks: A game theoretic approach

Reinforcement Learning Enhanced Iterative Power Allocation in Stochastic Cognitive Wireless Mesh Networks

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Distributed iterative power allocation in cognitive wireless mesh networks

Green Power Control in Cognitive Wireless Networks

Robust Spectrum-Energy Efficiency for Green Cognitive Communications

QoS Optimization for Mobile Ad Hoc Cloud: A Multi-Agent Independent Learning Approach

Analysis and Optimization of Power Control in Multiuser Cognitive Wireless Networks

Q-Learning-Based Spectrum Access for Multimedia Transmission Over Cognitive Radio Networks

Resource Allocation for Green Cognitive Radios: Energy Efficiency Maximization

Deep Q-learning multiple networks based dynamic spectrum access with energy harvesting for green cognitive radio network

Energy-efficient power allocation in cognitive sensor networks: a coupled constraint game approach

Energy-Efficient Cooperative Transmission in Ultra-Dense Millimeter-Wave Network: Multi-Agent Q-Learning Approach

A Cooperative Q-learning Approach for Real-time Power Allocation in Femtocell Networks

A Multi-Agent Multi-Environment Mixed Q-Learning for Partially Decentralized Wireless Network Optimization