Abstract:With the exponential growth of mobile users, ensuring high-quality network coverage has become paramount. Large-scale mobile networks consist of numerous base stations (BSs), each with adjustable parameters such as angles and beam widths. Automatically optimizing network coverage can be difficult due to environmental factors and the interdependence of the adjustable parameters. Due to the inherent uncertainties and unpredictable nature of large-scale wireless networks, traditional methods such as heuristics and meta-heuristics lack the adaptability and scalability required to cope with their dynamic environment. To address these challenges, we propose utilizing digital twin and reinforcement learning (RL) techniques within mobile networks characterized by multiple collaborating agents. We initially introduce DT-SimNet, a digital twin-enabled mobile network simulator to facilitate optimization evaluation. DT-SimNet can efficiently simulate communication behaviors of network elements within a complex environment while revealing user mobility patterns. Moreover, to address challenges arising from multifaceted relationships among users, BSs, and the parameters across BSs, we introduce an innovative strategy named Optimized Multi-Agent Proximal Policy Optimization with Self-supervised Prediction (OMAPPO-SSP). Compared to MAPPO, which leads to limited applicability and inferior performance due to the dynamic characteristics of 5G networks, this approach leverages network structure optimization and a self-supervised prediction mechanism, employing multi-agent reinforcement learning (MARL) principles to enhance efficiency. By harnessing collaborative neural networks, OMAPPO-SSP facilitates the explicit learning of behavioral interactions among all BSs, enabling effective decision-making in environments characterized by intricate spatial relationships, dynamic user behaviors, and diverse interactions. Extensive experiments are conducted to validate the efficiency and effectiveness of the OMAPPO-SSP. Within the target area, OMAPPO-SSP achieves a coverage ratio of 94.66% and an average throughput of 89746 bits per second (bps), demonstrating significant improvements compared to competing methods.

An Optimization Method for GSM Network Covering Based on TA

Traffic Analysis Zone Based Urban Activity Study with Aggregate Mobile Network Data

Exploration on optimization of large-scale and complex GSM networks

Joint Coverage Optimization of Multiple Sectors for Cellular Networks

The Optimization of Genetic Algorithm in Wireless Sensor Network Coverage

A Mathematical Model for Joint Optimization of Coverage and Capacity in Self-Organizing Network in Centralized Manner

Automatic frequency optimization method based on measurement report data

An Accurate Method of Adding New Site Based on Monte-Carlo Simulation

An Android-based distributed test data acquisition intelligent system for mobile network optimization

A "Breathing" Mobile Communication Network

Coverage and Capacity Optimization Based on Tabu Search in Ultra-Dense Network.

Sector-like optimization model of 5G base transceiver stations redeployment and the generalization

Coverage Optimization for Large-Scale Mobile Networks with Digital Twin and Multi-Agent Reinforcement Learning

Transmit power optimization in cellular networks with nomadic base stations

A Joint Optimization Algorithm for Trajectory Planning and Resource Allocation of Vehicle Mobile Base Stations for On-Demand Coverage Networks

A Dynamic Rate Assignment Scheme for Data Traffic in Cellular Multi-Code Cdma Networks

Temporal and Spatial Traffic Analysis Based on Human Mobility for Energy Efficient Cellular Network

Energy-Aware Cellular Deployment Strategy under Coverage Performance Constraints

Optimization of Network Resource Allocation Based on Genetic Algorithm

Cellular networks planning

A Coverage-Based Location Approach and Performance Evaluation for the Deployment of 5G Base Stations