Abstract:The agile earth observation satellite scheduling problem (AEOSSP), as a time-dependent and arduous combinatorial optimization problem, has been intensively studied in the past decades. Many studies have proposed non-iterative heuristic construction algorithms and iterative meta-heuristic algorithms to solve this problem. However, the heuristic construction algorithms spend a relatively shorter time at the expense of solution quality, while the iterative meta-heuristic algorithms accomplish a high-quality solution with a lot of time. To overcome the shortcomings of these approaches and efficiently utilize the historical scheduling information and task characteristics, this paper introduces a new neural network model based on the deep reinforcement learning and heuristic algorithm (DRL-HA) to the AEOSSP and proposes an innovative non-iterative heuristic algorithm. The DRL-HA is composed of a heuristic construction neural network (HCNN) model and a task arrangement algorithm (TAA), where the HCNN aims to generate the task planning sequence and the TAA generates the final feasible scheduling order of tasks. In this study, the DRL-HA is examined with other heuristic algorithms by a series of experiments. The results demonstrate that the DRL-HA outperforms competitors and HCNN possesses outstanding generalization ability for different scenario sizes and task distributions. Furthermore, HCNN, when used for generating initial solutions of meta-heuristic algorithms, can achieve improved profits and accelerate interactions. Therefore, the DRL-HA algorithm is verified to be an effective method for solving AEOSSP. In this way, the high-profit and high-timeliness of agile satellite scheduling can be guaranteed, and the solution of AEOSSP is further explored and improved.

Towards Utilitarian Combinatorial Assignment with Deep Neural Networks and Heuristic Algorithms

Deep Neural Networks for Linear Sum Assignment Problems.

A Graph-Based Neural Approach to Linear Sum Assignment Problems

Heterogeneous multi-agent task allocation based on graph neural network ant colony optimization algorithms

COMBHelper: A Neural Approach to Reduce Search Space for Graph Combinatorial Problems

Neural Combinatorial Optimization: a New Player in the Field

Solving the Assignment Problem with the Improved Dual Neural Network

DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimization

A lifelong learning hyper-heuristic method for bin packing

Threshold-aware Learning to Generate Feasible Solutions for Mixed Integer Programs

Genetic Algorithms with Neural Cost Predictor for Solving Hierarchical Vehicle Routing Problems

DE-DQN: A Dual-Embedding Based Deep Q-Network for Task Assignment Problem in Spatial Crowdsourcing

Assignment Problem Based Deep Embedding

Deep Learning Based Resource Assignment for Wireless Networks

Exact Combinatorial Optimization with Temporo-Attentional Graph Neural Networks

Exploiting Expert Knowledge for Assigning Firms to Industries: A Novel Deep Learning Method

A Heuristic Construction Neural Network Method for the Time-Dependent Agile Earth Observation Satellite Scheduling Problem

A Differentiable Approach to Combinatorial Optimization using Dataless Neural Networks

Towards Optimally Efficient Tree Search with Deep Learning

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks

Unveiling the Limits of Learned Local Search Heuristics: Are You the Mightiest of the Meek?