Abstract:With the exponential growth of mobile users, ensuring high-quality network coverage has become paramount. Large-scale mobile networks consist of numerous base stations (BSs), each with adjustable parameters such as angles and beam widths. Automatically optimizing network coverage can be difficult due to environmental factors and the interdependence of the adjustable parameters. Due to the inherent uncertainties and unpredictable nature of large-scale wireless networks, traditional methods such as heuristics and meta-heuristics lack the adaptability and scalability required to cope with their dynamic environment. To address these challenges, we propose utilizing digital twin and reinforcement learning (RL) techniques within mobile networks characterized by multiple collaborating agents. We initially introduce DT-SimNet, a digital twin-enabled mobile network simulator to facilitate optimization evaluation. DT-SimNet can efficiently simulate communication behaviors of network elements within a complex environment while revealing user mobility patterns. Moreover, to address challenges arising from multifaceted relationships among users, BSs, and the parameters across BSs, we introduce an innovative strategy named Optimized Multi-Agent Proximal Policy Optimization with Self-supervised Prediction (OMAPPO-SSP). Compared to MAPPO, which leads to limited applicability and inferior performance due to the dynamic characteristics of 5G networks, this approach leverages network structure optimization and a self-supervised prediction mechanism, employing multi-agent reinforcement learning (MARL) principles to enhance efficiency. By harnessing collaborative neural networks, OMAPPO-SSP facilitates the explicit learning of behavioral interactions among all BSs, enabling effective decision-making in environments characterized by intricate spatial relationships, dynamic user behaviors, and diverse interactions. Extensive experiments are conducted to validate the efficiency and effectiveness of the OMAPPO-SSP. Within the target area, OMAPPO-SSP achieves a coverage ratio of 94.66% and an average throughput of 89746 bits per second (bps), demonstrating significant improvements compared to competing methods.

Deep Learning–Based Coverage and Capacity Optimization

Coverage Optimization for Large-Scale Mobile Networks with Digital Twin and Multi-Agent Reinforcement Learning

DECCO: Deep-Learning Enabled Coverage and Capacity Optimization for Massive MIMO Systems.

Coverage and Capacity Optimization in STAR-RISs Assisted Networks: A Machine Learning Approach

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Digital Twin Enhanced Multi-Agent Reinforcement Learning for Large-Scale Mobile Network Coverage Optimization

Cellular Network Capacity and Coverage Enhancement with MDT Data and Deep Reinforcement Learning

Multicell Power Control under QoS Requirements with CNet

Deep Learning Based Optimization in Wireless Network

Deep Learning for Radio Resource Allocation in Multi-Cell Networks

Deep mobile traffic forecast and complementary base station clustering for C-RAN optimization

Deep Learning Based Cooperative Resource Allocation in 5G Wireless Networks

Coverage and Capacity Optimization Based on Tabu Search in Ultra-Dense Network.

Deep Learning for Physical-Layer 5G Wireless Techniques: Opportunities, Challenges and Solutions

Optimizing Multi-Tier Cellular Networks With Deep Learning for 6G Consumer Electronics Communications

Deep Learning-Based Intelligent Dual Connectivity for Mobility Management in Dense Network.

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

DeepCC: Bridging the Gap Between Congestion Control and Applications Via Multiobjective Optimization

Deep Reinforcement Learning for Intelligent Communications