Abstract:The low earth orbit (LEO) satellite network is regarded as a promising technology for delivering seamless service to remote areas such as rural areas. In this paper, we consider a dynamic data offloading problem in ultra-dense LEO satellites networks with large-scale ground users, where each ground user makes the distributed offloading decision based on its state information, the influence from other ground users, and the fees paid to satellites. To investigate the interaction problem between ground users and satellites, we formulate the problem as a Stackelberg game. Specifically, the satellites serve as the leaders, who decide the data service price at each time slot. The ground users, on the contrary, are the followers who decide the power control based on their states, the influence from other ground users and the fees paid to satellites. Since the influence is difficult to estimate due to the large number of ground users, we employ the mean field game algorithm to transform the influence from others and satellites into the mean field term, and reformulate the optimization problem as a Stackelberg mean field game (SMFG). Each ground user makes the data offloading decision by learning the future impact of the whole network distributively. For ground users, we solve the power control optimization problem by utilizing the G-prox primal-dual hybrid gradient (PDHG) algorithm, where the Fokker-Planck-Kolmogorov (FPK) equation is converted into a linear form via the Taylor expansion. For satellites, we address the service pricing optimization problem by using the adjoint algorithm. Finally, the numerical results demonstrate the effectiveness of the proposed algorithm.

Distributed Satellite Mission Planning via Learning in Games

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Mission planning for Earth observation satellite with competitive learning strategy

A Distributed Self-Reconfiguration Planning Algorithm for Modular Satellites

A game theoretic self-organization for satellite-based optical sensor allocation

Distributed Formation Control with Open-Loop Nash Strategy

Mission Planning for Distributed Multiple Agile Earth Observing Satellites by Attention-Based Deep Reinforcement Learning Method

Autonomous Target Revisiting Planning for LEO Observing Constellations Based on Improved Contract Network Protocol

An Algorithm of Cooperative Multiple Satellites Mission Planning Based on Multi-agent Reinforcement Learning

Demand-Aware Distributed Link Allocation in a Multilayer Heterogeneous Satellite Network: A Game Theory Approach

A Learnable Ant Colony Optimization to the Mission Planning of Multiple Satellites

A Bilevel Programming Approach for Optimizing Multi-Satellite Collaborative Mission Planning

Multi-Agent Based Dynamic Mission Planning For Satellite Data Transmission

Distributed Data Offloading in Ultra-Dense LEO Satellite Networks: A Stackelberg Mean-Field Game Approach

Multi Agent Based Networking Satellite Tasks Scheduling With Department Collaborative Mechanism

Distributed Machine Learning with Strategic Network Design: A Game-Theoretic Perspective

Distributed Optimal Formation Algorithm for Multi-Satellites System with Time-Varying Performance Function

Multi-Satellite Mission Planning for Environmental and Disaster Monitoring Satellite System

Graph-Driven Resource Allocation Strategies in Satellite IoT: A Cooperative Game Theoretic Approach

Adaptive differential game for modular reconfigurable satellites based on neural network observer

Satellite Mission Planning for Moving Targets Observation Via Data Driven Approach