Abstract:The agile earth observation satellite scheduling problem (AEOSSP), as a time-dependent and arduous combinatorial optimization problem, has been intensively studied in the past decades. Many studies have proposed non-iterative heuristic construction algorithms and iterative meta-heuristic algorithms to solve this problem. However, the heuristic construction algorithms spend a relatively shorter time at the expense of solution quality, while the iterative meta-heuristic algorithms accomplish a high-quality solution with a lot of time. To overcome the shortcomings of these approaches and efficiently utilize the historical scheduling information and task characteristics, this paper introduces a new neural network model based on the deep reinforcement learning and heuristic algorithm (DRL-HA) to the AEOSSP and proposes an innovative non-iterative heuristic algorithm. The DRL-HA is composed of a heuristic construction neural network (HCNN) model and a task arrangement algorithm (TAA), where the HCNN aims to generate the task planning sequence and the TAA generates the final feasible scheduling order of tasks. In this study, the DRL-HA is examined with other heuristic algorithms by a series of experiments. The results demonstrate that the DRL-HA outperforms competitors and HCNN possesses outstanding generalization ability for different scenario sizes and task distributions. Furthermore, HCNN, when used for generating initial solutions of meta-heuristic algorithms, can achieve improved profits and accelerate interactions. Therefore, the DRL-HA algorithm is verified to be an effective method for solving AEOSSP. In this way, the high-profit and high-timeliness of agile satellite scheduling can be guaranteed, and the solution of AEOSSP is further explored and improved.

Time Stamped States based Heuristic Algorithm for Spacecraft Mission Planning

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Design for Autonomous Mission Planning System

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Heuristic Algorithm for Dynamic Task Planning of Early Warning System of Low Earth Orbit

A Spacecraft Onboard Autonomous Task Scheduling Method Based on Hierarchical Task Network-Timeline

Timeline Based Autonomous Mission Planning System for Deep Space Exploration

Research on High-Dimensional Motion Planning of Agile and Autonomous On-Orbit Servicing Spacecraft Considering Time

A Heuristic Construction Neural Network Method for the Time-Dependent Agile Earth Observation Satellite Scheduling Problem

Onboard spacecraft slew-planning by heuristic state-space search and optimization

Autonomous Attitude Maneuver Planning for Spacecraft under Complex Constraints

Research on Four-Dimensional Attitude Motion Planning of Agile and Autonomous Spacecraft with Time

Realization of Multi-Agent Planning System for Autonomous Spacecraft

EHSP: an Efficient Heuristic Sampling-Based Planner for Autonomous UAV Exploration

Hybrid Heuristic Online Planning for POMDPs

A DQN-based Hyperheuristic Algorithm for Emergency Scheduling of Earth Observation Satellites

Onboard Mission Planning for Autonomous Avoidance of Spacecraft Subject to Various Orbital Threats: an SMT-Based Approach

Multi-satellite Mission Planning Algorithm Based on Preemptive Priority Model

Autonomy in the Real-World: Autonomous Trajectory Planning for Asteroid Reconnaissance via Stochastic Optimization

Robust Counterexample-guided Optimization for Planning from Differentiable Temporal Logic

Hierarchical Framework for Space Exploration Campaign Schedule Optimization