SDDRL-SR: A High-Reliability Satellite Routing Algorithm Based on Deep Reinforcement Learning

Zhaolong Ding,Zijian Yang,Huijie Liu,Feng Tian
DOI: https://doi.org/10.1109/VTC2024-Spring62846.2024.10683203
2024-06-24
Abstract:With the widespread use of satellite communications in low earth orbit (LEO), satellite routing has become an important component in ensuring that information can be transmitted efficiently and reliably. However, the time-varying topology and unstable nature of inter-satellite links (ISLs) make it challenging to design LEO satellite routing that guarantees low end-to-end latency. In this paper, we formulate this problem as an optimization problem that aims to minimize the end-to-end latency. We propose a Two-Hop Sate-Aware and Dijkstra-Aided Deep Reinforcement Learning Satellite Routing method (SDDRL-SR) which utilizes Dijkstra's algorithm for supervised training to accelerate the convergence of the algorithm. In the online execution phase, we design a Two-Hop Convergence method that updates the routing strategy by predicting the future two-hop state of the data. Experimental results show that the proposed SDDRL-SR outperforms the Deep Q-Network (DQN), Dijkstra and random routing in the performance of average delay and packet arriving ratio.
Engineering,Computer Science
What problem does this paper attempt to address?