Abstract:Nowadays, cognitive small cell networks (CSCNs) have been widely accepted as a promising and efficient method to deal with exponentially increasing demand of wireless data services. As small cells become smaller and denser, inter-cell interference (ICI) at user equipments (UEs), coming from adjacent base stations (BSs), expanded dramatically and has grown more complicated to be managed. In order to improve cellular throughput in randomly changing small cell networks (SCNs), this article investigates the problem of joint channel and power allocation with dynamic active BSs, using dynamic stochastic game-theoretic learning solutions. It is challenging to address this optimization problem especially when active BSs sets are randomly changing from slot to slot. Dynamic asymmetric graphical game for network throughput maximization will be proposed in this article. It is proved to be an exact potential game (EPG) and the best Nash equilibria of this game correspond to the optimal solutions of this optimization problem. To cope with the difficulties of uncertainty and dynamicity in SCNs, a dynamic joint channel and power selection stochastic learning algorithm (DJCPS-SLA) is put forward, which is analytically proved converging to the Nash equilibria of the accurately formulated game upon changing active BSs sets. The performance of the proposed learning algorithm, DJCPS-SLA, far surpasses that of random selection algorithm for joint channel and power allocation. Moreover, the dynamics promote the network throughput to some extent. Finally, the simulation results validate the convergence, annotates a trade-off between dynamicity, optimality, and robustness.

Dynamic channel selection in unknown environment based on graphical game and multi-Q learning

QoE-oriented Partially Overlapping Channel Access in Wireless Networks: a Game-Theoretic Learning Approach

Pricing-Based Channel Selection for D2D Content Sharing in Dynamic Environments

Dynamic Spectrum Access in Time-varying Environment: Distributed Learning Beyond Expectation Optimization

A Prediction And Learning Based Approach To Network Selection In Dynamic Environments

Joint Channel And Power Allocation In Dynamic Cognitive Small Cell Networks Using Asymmetric Graphical Game

A Game Theory-Based Asymmetric Multi-Channel Selection Algorithm in Wireless Ad Hoc Networks

Dynamic Spectrum Access Algorithm Based on Graphical Game in Distributed Wireless Network

Network selection strategy based on game theory in heterogeneous multi-access environment

Network Selection in Cognitive Heterogeneous Networks Using Stochastic Learning

Q-Learning for Non-Cooperative Channel Access Game of Cognitive Radio Networks

An Adaptive Learning Based Network Selection Approach for 5G Dynamic Environments

A Game-Theoretic Learning Model in Multi-Agent Systems

Multi-Channel Sensing and Access Game: Bayesian Social Learning with Negative Network Externality

Multi-agent Q-Learning of Channel Selection in Multi-user Cognitive Radio Systems: A Two by Two Case

Dynamic Resource Allocations Based on Q-learning for D2D Communication in Cellular Networks

Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks

Off-policy Q-learning: Solving Nash Equilibrium of Multi-Player Games with Network-Induced Delay and Unmeasured State.

Opportunistic dynamic channel allocation based on chain store game

Dynamic computation offloading in time-varying environment for ultra-dense networks:a stochastic game approach

Non-cooperative channel allocation in Ad-Hoc networks using game theory.