Abstract:With the exponential growth of mobile users, ensuring high-quality network coverage has become paramount. Large-scale mobile networks consist of numerous base stations (BSs), each with adjustable parameters such as angles and beam widths. Automatically optimizing network coverage can be difficult due to environmental factors and the interdependence of the adjustable parameters. Due to the inherent uncertainties and unpredictable nature of large-scale wireless networks, traditional methods such as heuristics and meta-heuristics lack the adaptability and scalability required to cope with their dynamic environment. To address these challenges, we propose utilizing digital twin and reinforcement learning (RL) techniques within mobile networks characterized by multiple collaborating agents. We initially introduce DT-SimNet, a digital twin-enabled mobile network simulator to facilitate optimization evaluation. DT-SimNet can efficiently simulate communication behaviors of network elements within a complex environment while revealing user mobility patterns. Moreover, to address challenges arising from multifaceted relationships among users, BSs, and the parameters across BSs, we introduce an innovative strategy named Optimized Multi-Agent Proximal Policy Optimization with Self-supervised Prediction (OMAPPO-SSP). Compared to MAPPO, which leads to limited applicability and inferior performance due to the dynamic characteristics of 5G networks, this approach leverages network structure optimization and a self-supervised prediction mechanism, employing multi-agent reinforcement learning (MARL) principles to enhance efficiency. By harnessing collaborative neural networks, OMAPPO-SSP facilitates the explicit learning of behavioral interactions among all BSs, enabling effective decision-making in environments characterized by intricate spatial relationships, dynamic user behaviors, and diverse interactions. Extensive experiments are conducted to validate the efficiency and effectiveness of the OMAPPO-SSP. Within the target area, OMAPPO-SSP achieves a coverage ratio of 94.66% and an average throughput of 89746 bits per second (bps), demonstrating significant improvements compared to competing methods.

Coverage enhancement of mobile multi-agent networks while preserving global connectivity

Globally Optimal Coverage for Non-convex Environments with Mobile Sensor Networks

Implementation of Multi-agent Based Hybrid Architecture for Autonomous Mobile Robots

Multi-Agent Coverage Path Planning via Proximity Interaction and Cooperation

Distributed Extremum Seeking and Formation Control for Nonholonomic Mobile Network.

Integrated Coverage Control and Security Connectivity in Mobile Sensor Networks

Decentralized Dynamic Coverage Control for Mobile Sensor Networks in a Non‐convex Environment

Multi-agent Coverage Control: From Discrete Assignments to Continuous Multi-agent Distribution Matching

Sensor-based Multi-agent Coverage Control with Spatial Separation in Unstructured Environments

Multi-agent coverage control based on improved community discovery algorithm

Towards Optimal Barrier Coverage in Wireless Sensor and Actor Networks

Timer-Based Coverage Control for Mobile Sensors

Decentralized Adaptive Awareness Coverage Control for Multi-Agent Networks.

Safe Adaptive Multi-Agent Coverage Control

Deep and Decentralized Multi-Agent Coverage of a Target with Unknown Distribution

Multi-Agent Path Finding with Heterogeneous Geometric and Kinematic Constraints in Continuous Space

Coverage-aware and Reinforcement Learning Using Multi-agent Approach for HD Map QoS in a Realistic Environment

Sectorial coverage control with load balancing in non-convex hollow environments

Is Limited Information Enough? An Approximate Multi-agent Coverage Control in Non-Convex Discrete Environments

Coverage Optimization for Large-Scale Mobile Networks with Digital Twin and Multi-Agent Reinforcement Learning

Optimal Multi-Agent Map Coverage Path Planning Algorithm