Scheduling single-satellite observation and transmission tasks by using hybrid Actor-Critic reinforcement learning

Zhijiang Wen,Lu Li,Jiakai Song,Shengyu Zhang,Haiying Hu
DOI: https://doi.org/10.1016/j.asr.2022.10.024
IF: 2.611
2022-10-14
Advances in Space Research
Abstract:Earth observation satellites(EOS) generate a large amount of observation data in intensive observation scenarios, while the ability of data storage on the EOS is limited. It makes integrating satellite observation and data transmission tasks for EOS imperative. This paper establishes a time-continuous model for the single EOS integrated scheduling problem, which considers data transmission and observation simultaneously. A hybrid Actor-Critic reinforcement learning method is adopted to solve the EOS integrated scheduling problem for a more efficient solution in intensive observation scenarios. Furthermore, the algorithm can flexibly determine the start and end time of the data transmission task. Experimental results show that the hybrid Actor-Critic reinforcement learning method deals with a large scale of problems with high efficiency and good results.
geosciences, multidisciplinary,meteorology & atmospheric sciences,astronomy & astrophysics,engineering, aerospace
What problem does this paper attempt to address?