Abstract:The framework of cognitive wireless networks is expected to endow the wireless devices with the cognition-intelligence ability with which they can efficiently learn and respond to the dynamic wireless environment. In many practical scenarios, the complexity of network dynamics makes it difficult to determine the network evolution model in advance. Thus, the wireless decision-making entities may face a black-box network control problem and the model-based network management mechanisms will be no longer applicable. In contrast, model-free learning enables the decision-making entities to adapt their behaviors based on the reinforcement from their interaction with the environment and (implicitly) build their understanding of the system from scratch through trial-and-error. Such characteristics are highly in accordance with the requirement of cognition-based intelligence for devices in cognitive wireless networks. Therefore, model-free learning has been considered as one key implementation approach to adaptive, self-organized network control in cognitive wireless networks. In this paper, we provide a comprehensive survey on the applications of the state-of-the-art model-free learning mechanisms in cognitive wireless networks. According to the system models on which those applications are based, a systematic overview of the learning algorithms in the domains of single-agent system, multiagent systems, and multiplayer games is provided. The applications of model-free learning to various problems in cognitive wireless networks are discussed with the focus on how the learning mechanisms help to provide the solutions to these problems and improve the network performance over the model-based, non-adaptive methods. Finally, a broad spectrum of challenges and open issues is discussed to offer a guideline for the future research directions.

Learning Methodologies for Wireless Big Data Networks: A Markovian Game-Theoretic Perspective.

The Confluence of Networks, Games and Learning

A Game-Theoretic Learning Framework for Multi-Agent Intelligent Wireless Networks

Game-Theoretic Learning Anti-Jamming Approaches in Wireless Networks

Wireless Network Association Game with Data-Driven Statistical Modeling.

Game Theoretic Approaches to Massive Data Processing in Wireless Networks

A Game-Theoretic Learning Model in Multi-Agent Systems

A game theoretic approach for the distributed control of multi-agent systems under directed and time-varying topology

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

A Markovian Game-Theoretical Power Control Approach in Cognitive Radio Networks: A Multi-Agent Learning Perspective

Distributed Machine Learning with Strategic Network Design: A Game-Theoretic Perspective

A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks

Mean Field Game Applications in Ultra-Dense 5G, 6G, and Beyond Wireless Networks

Fairly Coexistence Of Lte And Wifi: A Markov Game Framework

A Game-Theoretic Learning Approach for Anti-Jamming Dynamic Spectrum Access in Dense Wireless Networks

Stackelberg Game Theoretic Framework in Cognitive Green Heterogeneous Networks

Dynamic Chinese Restaurant Game: Theory and Application to Cognitive Radio Networks

Scalable Learning Paradigms for Data-Driven Wireless Communication

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

A Reinforcement Learning Approach to Energy Efficiency and QoS in 5G Wireless Networks

Game Theory Framework Applied to Wireless Communication Networks