Abstract:There hardly exists a general solver that is efficient for scheduling problems due to their diversity and complexity. In this study, we develop a two-stage framework, in which reinforcement learning (RL) and traditional operations research (OR) algorithms are combined together to efficiently deal with complex scheduling problems. The scheduling problem is solved in two stages, including a finite Markov decision process (MDP) and a mixed-integer programming process, respectively. This offers a novel and general paradigm that combines RL with OR approaches to solving scheduling problems, which leverages the respective strengths of RL and OR: The MDP narrows down the search space of the original problem through an RL method, while the mixed-integer programming process is settled by an OR algorithm. These two stages are performed iteratively and interactively until the termination criterion has been met. Under this idea, two implementation versions of the combination methods of RL and OR are put forward. The agile Earth observation satellite scheduling problem is selected as an example to demonstrate the effectiveness of the proposed scheduling framework and methods. The convergence and generalization capability of the methods are verified by the performance of training scenarios, while the efficiency and accuracy are tested in 50 untrained scenarios. The results show that the proposed algorithms could stably and efficiently obtain satisfactory scheduling schemes for agile Earth observation satellite scheduling problems. In addition, it can be found that RL-based optimization algorithms have stronger scalability than non-learning algorithms. This work reveals the advantage of combining reinforcement learning methods with heuristic methods or mathematical programming methods for solving complex combinatorial optimization problems.

Pearly penile papules: a review

Robustness Multi-Objective Optimization for Parallel Robot Based on Subregional Meta-Heuristic Iteration

Visually-driven parallel solving of multi-objective land-use allocation problems: a case study in Chelan, Washington

Task-based visual analytics for interactive multiobjective optimization

Keeping Designers in the Loop: Communicating Inherent Algorithmic Trade-offs Across Multiple Objectives

A Visual Web Tool to Perform What-If Analysis of Optimization Approaches

Integrated Optimisation of Loading Schedules and Delivery Routes

A Visualizable Test Problem Generator for Many-Objective Optimization

A framework for the interactive resolution of multi-objective vehicle routing problems

Decomposition, Reformulation, and Diving in University Course Timetabling

Supporting Visual Exploration of Iterative Job Scheduling

AI-Copilot for Business Optimisation: A Framework and A Case Study in Production Scheduling

A User-centered Approach for Optimizing Information Visualizations

The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures

Learning Hybrid Algorithms for Vehicle Routing Problems

A Two-stage Framework and Reinforcement Learning-based Optimization Algorithms for Complex Scheduling Problems

Diagnosing Infeasible Optimization Problems Using Large Language Models

Attention, Learn to Solve Routing Problems!

Automated Usability Improvement of Two-Dimensional Graphical Interfaces through the Simulation of User's Operations

An AI-based Simulation and Optimization Framework for Logistic Systems

Development and initial usability evaluation of a digital tool for simulation-based multi-objective optimization of productivity and worker well-being