Abstract:Network-assisted full-duplex (NAFD) cell-free (CF) networks use half-duplex access points (APs) to enable the network-level in-band full-duplex. By dynamically allocating each AP to perform either uplink reception or downlink transmission at each time slot, the AP duplex mode optimization algorithm (ADMOA) plays a crucial role in improving the performance of the NAFD CF systems. However, most existing ADMOAs focus on maximizing spectral efficiency (SE) and overlook the issue of decreasing system resource utilization in massive Internet-of-Things (mIoT) scenarios. Aiming at making better use of system resources in the NAFD CF networks with time-varying active user equipment (UE), this article proposes a "preallocation-optimization" mechanism. First, in the preallocation part, we establish an index that directly reflects the service satisfaction of the active UEs and propose a network load prediction algorithm, which can accurately predict the network load and preallocate enough resource blocks. Then, in the optimization part, the multiobjective optimization problem for getting the tradeoff between the sum of SE and resource utilization is established. We design a deep reinforcement learning (DRL)-based-ADMOA, which determines a clever policy to solve it in a dynamic environment. In addition, we further design a hierarchical reinforcement learning-based-ADMOA by decomposing the policy into two level, which successfully simplifies the network structure and addresses the sparse reward problem in DRL. Finally, the simulation results show that the proposed schemes achieve the performance similar to that of the exhaustionmethodwith very low complexity, and are more suitable for dynamic mIoT scenarios.

A Practical Heterogeneous Network Optimisation Algorithm Based on Reinforcement Learning

Reinforcement Learning Based Dynamic Network Self-optimization for Heterogeneous Networks

Adaptive Ant-Based Dynamic Routing Algorithm

Q-learning Based Heterogenous Network Self-Optimization for Reconfigurable Network with CPC Assistance

A Novel Network Selection Approach in 5G Heterogeneous Networks Using Q-Learning

Distributed Deep Reinforcement Learning-Based Spectrum and Power Allocation for Heterogeneous Networks

Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks

Autonomic Joint Session Scheduling Strategies for Heterogeneous Wireless Networks.

A Prediction And Learning Based Approach To Network Selection In Dynamic Environments

Decentralized Routing and Radio Resource Allocation in Wireless Ad Hoc Networks via Graph Reinforcement Learning

Deep Reinforcement Learning Based Resource Allocation for Heterogeneous Networks

Heterogeneous Network Selection Algorithm Based on Deep Q Learning.

Deep Reinforce Learning and Meta-Learning Based Resource Allocation in Cellular Heterogeneous Networks

Multi-Agent Reinforcement Learning for Dynamic Spectrum Access.

Q-Learning Based Network Selection for WCDMA/WLAN Heterogeneous Wireless Networks

Hierarchical Reinforcement Learning for AP Duplex Mode Optimization in Network-Assisted Full-Duplex Cell-Free Networks

Deep reinforcement learning for RAN optimization and control

An Adaptive Learning Based Network Selection Approach for 5G Dynamic Environments

Reinforcement Learning Based Dynamic Energy-Saving Algorithm For Three-Tier Heterogeneous Networks

Multi-Agent Deep Reinforcement Learning Based Adaptive User Association In Heterogeneous Networks

Safe-NORA: Safe Reinforcement Learning-based Mobile Network Resource Allocation for Diverse User Demands