Abstract:Mobile traffic forecasting allows operators to anticipate network dynamics and performance in advance, offering substantial potential for enhancing service quality and improving user experience. However, existing models are often task-oriented and are trained with tailored data, which limits their effectiveness in diverse mobile network tasks of Base Station (BS) deployment, resource allocation, energy optimization, etc. and hinders generalization across different urban environments. Foundation models have made remarkable strides across various domains of NLP and CV due to their multi-tasking adaption and zero/few-shot learning capabilities. In this paper, we propose an innovative Foundation model for Mo}bile traffic forecasting (FoMo), aiming to handle diverse forecasting tasks of short/long-term predictions and distribution generation across multiple cities to support network planning and optimization. FoMo combines diffusion models and transformers, where various spatio-temporal masks are proposed to enable FoMo to learn intrinsic features of different tasks, and a contrastive learning strategy is developed to capture the correlations between mobile traffic and urban contexts, thereby improving its transfer learning capability. Extensive experiments on 9 real-world datasets demonstrate that FoMo outperforms current models concerning diverse forecasting tasks and zero/few-shot learning, showcasing a strong universality. We further deploy the FoMo on the JiuTian optimization platform of China Mobile, where we use the predicted mobile data to formulate network planning and optimization applications, including BS deployment, resource block scheduling, and BS sleep control.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve several key problems in mobile traffic prediction, as follows: 1. **Limitations of existing models**: - Existing models are usually task - oriented and trained with customized data, which limits their effectiveness in different mobile network tasks, such as base station (BS) deployment, resource allocation, and energy optimization. - These models are difficult to generalize across different urban environments. 2. **Multi - task adaptability and zero / few - sample learning ability**: - Foundation Models have made remarkable progress in the fields of natural language processing (NLP) and computer vision (CV). These models have multi - task adaptability and zero / few - sample learning ability. - Mobile traffic prediction requires a foundation model that can handle multiple prediction tasks (such as short - term / long - term prediction and distribution generation) to support network planning and optimization. 3. **Universality across cities and scenarios**: - Building a foundation model that can work effectively in multiple cities and scenarios is crucial for mobile networks. This not only helps operators foresee network dynamics and performance in advance, but also improves service quality and user experience. 4. **Specific challenges**: - **Limited generalization ability**: Mobile traffic data is affected by spatio - temporal dynamics. The geographical environments, lifestyles, and urban layouts of different cities vary greatly, making it difficult for existing models to capture the diverse spatio - temporal patterns in large - scale data. - **Limited adaptability to multiple scenarios**: Current models are usually designed for specific tasks, increasing complexity and deployment costs. - **Lack of a general representation of mobile traffic**: Unlike the standardized formats in the language and vision fields, mobile traffic data is heterogeneous and it is difficult to directly apply pre - trained models. To solve these problems, the authors propose a foundation model based on the diffusion model - FoMo (Foundation model for Mobile traffic forecasting). This model combines the Transformer architecture and the contrastive learning strategy, aiming to handle multiple mobile traffic prediction tasks and achieve efficient generalization in multiple cities. ### Main contributions of FoMo - **The first foundation model for mobile traffic prediction**: FoMo is the first foundation model specifically designed for mobile traffic prediction and can handle multiple prediction tasks in different urban environments within a unified framework. - **Masked diffusion model**: The masked diffusion method and spatio - temporal masking strategy are adopted to enhance the multi - task ability and robustness of the model. - **Context - aware contrastive learning**: By introducing context features (such as user behavior and urban POI distribution), the prediction and transfer learning abilities are improved. - **Experimental verification**: Through extensive experiments on 9 real - world datasets, the superior performance of FoMo in multi - task prediction, zero / few - sample learning, and scalability is verified. ### Conclusion The paper proposes an innovative method to solve the key problems in mobile traffic prediction, especially making significant progress in generalization ability, multi - task adaptability, and zero / few - sample learning. The FoMo model demonstrates its strong universality and practicality in multiple cities and application scenarios.

FoMo: A Foundation Model for Mobile Traffic Forecasting with Diffusion Model

Modeling Real-Time Human Mobility Based on Mobile Phone and Transportation Data Fusion

Network-scale traffic prediction via knowledge transfer and regional MFD analysis

Hybrid Approach Combining Modified Gravity Model and Deep Learning for Short-Term Forecasting of Metro Transit Passenger Flows

Diffusion Model-based Mobile Traffic Generation with Open Data for Network Planning and Optimization

OpenCity: Open Spatio-Temporal Foundation Models for Traffic Prediction

Enhanced Multimodal Trajectory Prediction for Autonomous Vehicles Using Advanced Diffusion Model Techniques

xMTrans: Temporal Attentive Cross-Modality Fusion Transformer for Long-Term Traffic Prediction

A Multi-Channel Spatial-Temporal Transformer Model for Traffic Flow Forecasting

Fusion Matrix Prompt Enhanced Self-Attention Spatial-Temporal Interactive Traffic Forecasting Framework

Meta-STMF: Meta-Learning Based Spatial Temporal Prediction Model Fusion Approach

Building Transportation Foundation Model via Generative Graph Transformer

Urban Crowd Flow Forecasting Based on Cellular Network

TransFusion Model Fusion Mechanism Based on Transformer for Traffic Flow Prediction

Regional Features Conditioned Diffusion Models for 5G Network Traffic Generation

Traffic Flow Forecasting Based on Transformer with Diffusion Graph Attention Network

STLLM-DF: A Spatial-Temporal Large Language Model with Diffusion for Enhanced Multi-Mode Traffic System Forecasting

Spatiotemporal Fusion Transformer for large-scale traffic forecasting

Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting

Diffusion Models Meet Network Management: Improving Traffic Matrix Analysis with Diffusion-based Approach

A Spatio-Temporal Traffic Forecasting Model for Base Station in Cellular Network