Abstract:This paper deals with the problem of user association in heterogeneous networks (HetNets). With the existence of small cells, to better associate user equipment (UE) with base stations (BSs), we propose a novel collaborative filtering (CF)-based wireless network recommendation system, which involves social interactions among UEs. Different from traditional user association schemes, the UEs in the proposed system interact with each other by rating the BSs to improve recommendation qualities. Similarity between UEs' preferences to the quality of service (QoS) and historical information on the QoS of networks are taken into consideration. The core of the network recommendation system is a rating matrix maintained by the operator. A UE can automatically rate the connected BS according to real-time measured parameters (interference, packet loss rate, time delay, etc.) that it experiences during service. Taking the Voice over Internet Protocol (VoIP) service as an example, the measured parameters can be mapped to certain QoS levels with the E-model, which is used as the ratings. During the process of handover, the operator recommends the BSs to the UEs based on the rating matrix. While the ratings help the UEs gain better recommendation qualities, they tend to avoid the costs, e. g., computational and bandwidth resources. Therefore, the UEs have to trade off between the profits and costs brought about by the rating procedure. A satisfaction game is formulated to deal with this problem. We use a utility function to measure a UE's satisfaction. When every UE's utility comes to a preset level, the game is considered to reach the satisfaction equilibrium(SE). An algorithm is designed to learn the SE, and the convergence is analyzed. The advantages of the proposed system lie in two aspects. First, it comprehensively considers multiple factors that influence the QoS, instead of signal strength only. Second, the historical information helps UEs select BSs with better long-term QoS but not immediate QoS. Simulation results show the effectiveness of the learning algorithm on both learning the SE and avoiding severe congestions in each BS.

Deep Reinforcement Learning for User Association in Heterogeneous Networks with Dual Connectivity

Parallel Digital Twin-driven Deep Reinforcement Learning for User Association and Load Balancing in Dynamic Wireless Networks

BiLSTM Based Reinforcement Learning for Resource Allocation and User Association in LTE-U Networks

User-Centric Association in Ultra-Dense mmWave Networks via Deep Reinforcement Learning

A Distributed User Association Method for LTE-U by Enabling Q-Learning in Minority Game.

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Deep Reinforcement Learning-Based User Pairing In Full-Duplex Communication Systems

User Association for Millimeter-Wave Networks: A Machine Learning Approach

Minority Game for Distributed User Association in Unlicensed Heterogenous Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

User Association in Heterogeneous Networks: A Social Interaction Approach.

A Reinforcement Learning Based User Association Algorithm for UAV Networks

Deep Learning-Based Intelligent Dual Connectivity for Mobility Management in Dense Network.

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Joint User Association and Power Allocation in Heterogeneous Ultra Dense Network via Semi-Supervised Representation Learning

User Association and Power Allocation for User-Centric Smart-Duplex Networks via Tree-Structured Deep Reinforcement Learning

A deep reinforcement learning-based D2D spectrum allocation underlaying a cellular network

Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning

Joint Interference Alignment and Power Control for Dense Networks Via Deep Reinforcement Learning

Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks.

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks