Abstract:With the vision of supporting global internet access, satellite communication has emerged as a key component for sixth-generation (6G) communication networks. A pivotal trend for satellite communication is using Low Earth Orbit (LEO) satellites to construct a space-based backbone network, which necessitates establishing multi-hop communication paths between satellites with certain inter-satellite routing strategies. However, the vast number of satellites and the fast-varying network topology, combined with the diversified traffic demands, pose significant challenges for inter-satellite routing. In this paper, we propose a novel inter-satellite routing scheme that employs Graph Neural Networks (GNN) and Deep Reinforcement Learning (DRL) to address the above-mentioned challenges. The overall objective is minimizing network-wide average end-to-end delay, which can be achieved by selecting paths with low aggregated propagation delay and balancing the load distribution among various links. Based on this fact, we formulate the inter-satellite routing problem, in which the satellite network is modeled as a graph. Then, we design a GNN and DRL integrated solution framework, where GNN is employed to learn the complex relationship between satellite nodes in the graph and DRL is employed to make routing decisions that are adaptive to the features of satellite networks. Simulation results demonstrate that our solution can adapt to the time-varying network dynamics and diverse traffic demands, outperforming benchmark schemes in terms of average end-to-end delay, reliability, and link utilization.

Reinforcement learning based dynamic distributed routing scheme for mega LEO satellite networks

Distributed Routing Algorithm for LEO Satellite Network Based on Deep Reinforcement Learning

An Intelligent Routing Algorithm for LEO Satellites Based on Deep Reinforcement Learning

Reinforcement Learning Based Intelligent Routing for Software Defined LEO Satellite Networks

Multi-Commodity Flow Routing for Large-Scale LEO Satellite Networks Using Deep Reinforcement Learning

A Low-Complexity Routing Algorithm Based on Load Balancing for LEO Satellite Networks

Dynamic Routing Planning Method for Large-Scale Low-Orbit Satellite Networks Based on Location Guided and Multi-Agent DQN Network

A DRL Empowered Multipath Cooperative Routing for Ultra-Dense LEO Satellite Networks

Graph Neural Network and Reinforcement Learning Based Routing for Mega LEO Satellite Constellations

Satellite Network Routing Planning Method Based on Reinforcement Learning

A Low-Latency Routing Scheme with Traffic Balancing for LEO Satellite Networks

SDDRL-SR: A High-Reliability Satellite Routing Algorithm Based on Deep Reinforcement Learning

On An Intelligent Hierarchical Routing Strategy for Ultra-Dense Free Space Optical Low Earth Orbit Satellite Networks

Q-learning for distributed routing in LEO satellite constellations

Distributed Routing Strategy Based on Machine Learning for LEO Satellite Network

Inter-Satellite Routing for LEO Satellite Networks: A GNN and DRL Integrated Approach

An Active Distributed Qos Routing For Leo Satellite Communication Network

Trustworthy and Load-Balancing Routing Scheme for Satellite Services with Multi-Agent DRL.

An Efficient Differentiated Routing Scheme for MEO/LEO-Based Multi-Layer Satellite Networks

Deep Reinforcement Learning for Congestion Control and Routing Optimization in LEO Satellite Networks

Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks