Abstract:The agile earth observation satellite scheduling problem (AEOSSP) consists of selecting and scheduling a number of tasks from a set of user requests in order to optimize one or multiple criteria. In this paper, we consider a multi-objective version of AEOSSP (called MO-AEOSSP) where the failure rate and the timeliness of scheduled requests are optimized simultaneously. Due to its NP-hardness, traditional iterative problem-tailored heuristic methods are sensitive to problem instances and require massive computational overhead. We thus propose a deep reinforcement learning and parameter transfer based approach (RLPT) to tackle the MO-AEOSSP in a non-iterative manner. RLPT first decomposes the MO-AEOSSP into a number of scalarized sub-problems by a weight sum approach where each sub-problem can be formulated as a Markov Decision Process (MDP). RLPT then applies an encoder–decoder structure neural network (NN) trained by a deep reinforcement learning procedure to producing a high-quality schedule for each sub-problem. The resulting schedules of all scalarized sub-problems form an approximate pareto front for the MO-AEOSSP. Once a NN of a subproblem is trained, RLPT applies a parameter transfer strategy to reducing the training expenses for its neighboring sub-problems. Experimental results on a large set of randomly generated instances show that RLPT outperforms three classical multi-objective evolutionary algorithms (MOEAs) in terms of solution quality, solution distribution and computational efficiency. Results on various-size instances also show that RLPT is highly general and scalable. To the best of our knowledge, this study is the first attempt that applies deep reinforcement learning to a satellite scheduling problem considering multiple objectives.

Deep Reinforcement Learning-Based Periodic Earth Observation Scheduling for Agile Satellite Constellation.

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Mission Planning for Distributed Multiple Agile Earth Observing Satellites by Attention-Based Deep Reinforcement Learning Method

Two-Phase Neural Combinatorial Optimization with Reinforcement Learning for Agile Satellite Scheduling

An Online Distributed Satellite Cooperative Observation Scheduling Algorithm Based on Multiagent Deep Reinforcement Learning

An Integrated Scheduling Algorithm of Satellite Observation and Data Download Based on Multi-Agent Deep Reinforcement Learning

Revising the Observation Satellite Scheduling Problem Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Agile Satellite Scheduling Problem

Deep Reinforcement Learning for the Agile Earth Observation Satellite Scheduling Problem

Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times

Deep Reinforcement Learning with Local Attention for Single Agile Optical Satellite Scheduling Problem

Deep Reinforcement Learning Method for Satellite Range Scheduling Problem.

Deep Reinforcement Learning for Agile Earth Observation Satellites Scheduling Problem with Variable Image Duration

A Hierarchical Resource Scheduling Method for Satellite Control System Based on Deep Reinforcement Learning

A Fast Approach to Satellite Range Rescheduling Using Deep Reinforcement Learning

Deep reinforcement learning and parameter transfer based approach for the multi-objective agile earth observation satellite scheduling problem

Reinforcement Learning-Based Task Scheduling Algorithm for On-Satellite Data Analysis

Event-Triggered Deep Reinforcement Learning for Dynamic Task Scheduling in Multisatellite Resource Allocation.

Event-Triggered Deep Reinforcement Learning for Dynamic Task Scheduling in Multi-Satellite Resource Allocation

Tam-Ech: A Novel Method for Optimizing Multi-Agile Earth Observation Satellite Scheduling Problem Using Deep Q-Learning and Ensemble Heuristics

Deep Reinforcement Learning-Based Attention Decision Network for Agile Earth Observation Satellite Scheduling