Abstract:The agile earth observation satellite scheduling problem (AEOSSP), as a time-dependent and arduous combinatorial optimization problem, has been intensively studied in the past decades. Many studies have proposed non-iterative heuristic construction algorithms and iterative meta-heuristic algorithms to solve this problem. However, the heuristic construction algorithms spend a relatively shorter time at the expense of solution quality, while the iterative meta-heuristic algorithms accomplish a high-quality solution with a lot of time. To overcome the shortcomings of these approaches and efficiently utilize the historical scheduling information and task characteristics, this paper introduces a new neural network model based on the deep reinforcement learning and heuristic algorithm (DRL-HA) to the AEOSSP and proposes an innovative non-iterative heuristic algorithm. The DRL-HA is composed of a heuristic construction neural network (HCNN) model and a task arrangement algorithm (TAA), where the HCNN aims to generate the task planning sequence and the TAA generates the final feasible scheduling order of tasks. In this study, the DRL-HA is examined with other heuristic algorithms by a series of experiments. The results demonstrate that the DRL-HA outperforms competitors and HCNN possesses outstanding generalization ability for different scenario sizes and task distributions. Furthermore, HCNN, when used for generating initial solutions of meta-heuristic algorithms, can achieve improved profits and accelerate interactions. Therefore, the DRL-HA algorithm is verified to be an effective method for solving AEOSSP. In this way, the high-profit and high-timeliness of agile satellite scheduling can be guaranteed, and the solution of AEOSSP is further explored and improved.

A Heuristic Construction Neural Network Method for the Time-Dependent Agile Earth Observation Satellite Scheduling Problem

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Deep Reinforcement Learning for the Agile Earth Observation Satellite Scheduling Problem

Hybrid Deep Neural Network Scheduler for Job-Shop Problem Based on Convolution Two-Dimensional Transformation

Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times

Deep Reinforcement Learning-Based Periodic Earth Observation Scheduling for Agile Satellite Constellation.

Deep reinforcement learning and parameter transfer based approach for the multi-objective agile earth observation satellite scheduling problem

Two-Phase Neural Combinatorial Optimization with Reinforcement Learning for Agile Satellite Scheduling

A Hierarchical Resource Scheduling Method for Satellite Control System Based on Deep Reinforcement Learning

A data-driven improved genetic algorithm for agile earth observation satellite scheduling with time-dependent transition time

Deep Reinforcement Learning with Local Attention for Single Agile Optical Satellite Scheduling Problem

Deep Reinforcement Learning-Based Attention Decision Network for Agile Earth Observation Satellite Scheduling

Asymmetric path-relinking based heuristics for large-scale job scheduling problem in TDRSS

Mission Planning for Distributed Multiple Agile Earth Observing Satellites by Attention-Based Deep Reinforcement Learning Method

Event-Triggered Deep Reinforcement Learning for Dynamic Task Scheduling in Multi-Satellite Resource Allocation

A Data-Driven Parallel Scheduling Approach for Multiple Agile Earth Observation Satellites

A neural network based heuristic for resource-constrained project scheduling

An adaptive large neighborhood search metaheuristic for agile satellite scheduling with time-dependent transition time

A Generic Markov Decision Process Model and Reinforcement Learning Method for Scheduling Agile Earth Observation Satellites

An Adaptive Large Neighborhood Search Algorithm for the Satellite Data Transmission Scheduling Problem

Satellite Observation Scheduling with a Novel Adaptive Simulated Annealing Algorithm and a Dynamic Task Clustering Strategy