Abstract:Refinery production scheduling is a mixed-integer programming problem, which exists the issue of combinational explosion. Thus, solving a large-scale refinery production scheduling problem is time-consuming. This article proposes an approximate solution framework based on reinforcement learning (RL) for large-scale long-time refinery production scheduling problems to rapidly obtain a satisfactory solution. In the proposed algorithm, the Proximal Policy Optimization algorithm is used to process the continuous action. To address the cold start issue of RL in refinery scheduling problem, we present an initialization method for the actor of agent, which utilizes the operation knowledge of tractable small-scale problems to initialize the actor network, and the agent is trained in the environment of large-scale problems. Hence, the convergence of the RL algorithm is greatly accelerated. In addition, the product flowrate concept is used to express the state, making the scheduling agent scalable in terms of scheduling horizon. Experimental studies show, to large-scale refinery scheduling problems, the proposed algorithm can obtain better solutions than that of the CPLEX solver and the existing evolutionary algorithm in a much shorter solving time of the two methods. Note to Practitioners —Scheduling is a link between planning and execution, and it can bring huge economic benefits to the refinery enterprises. With the enlargement of scheduling horizon, the scale of scheduling problems increases dramatically. How to deal with this large-scale scheduling problem caused by a long scheduling horizon is a significant problem. In this paper, the proposed method learns a decision-maker by reinforcement learning and applies to large-scale problems to obtain a good solution quickly. The proposed method is essentially a heuristic algorithm, and it is easy to implement in practice. At present, more and more things will be integrated into one model, leading to the traditional solver cannot meet the application needs. The fast solution method is necessary to be used to solve this problem in the new era.

Safe reinforcement learning method integrating process knowledge for real-time scheduling of gas supply network

Secure Energy Management of Multi-Energy Microgrid: A Physical-Informed Safe Reinforcement Learning Approach

A deep reinforcement learning-based method for predictive management of demand response in natural gas pipeline networks

Safe Reinforcement Learning for Active Distribution Networks Reconfiguration Considering Uncertainty

Online Operational Decision-making for Integrated Electric-Gas Systems with Safe Reinforcement Learning

A systematic method for the optimization of gas supply reliability in natural gas pipeline network based on Bayesian networks and deep reinforcement learning

Real-Time Optimal Scheduling for Active Distribution Networks: A Graph Reinforcement Learning Method

Real-Time Optimal Power Flow Method Via Safe Deep Reinforcement Learning Based on Primal-Dual and Prior Knowledge Guidance

Rethinking Safe Policy Learning for Complex Constraints Satisfaction: A Glimpse in Real-Time Security Constrained Economic Dispatch Integrating Energy Storage Units

A Reinforcement Learning Based Large-Scale Refinery Production Scheduling Algorithm

Multi-Network Constrained Operational Optimization in Community Integrated Energy Systems: A Safe Reinforcement Learning Approach

A Low-Carbon Economic Dispatch Method for Power Systems with Carbon Capture Plants Based on Safe Reinforcement Learning

Reinforcement Learning for Blast Furnace Ironmaking Operation with Safety and Partial Observation Considerations.

Real-time scheduling of renewable power systems through planning-based reinforcement learning

Techno-Economic Modeling and Safe Operational Optimization of Multi-Network Constrained Integrated Community Energy Systems

Guided Probabilistic Reinforcement Learning for Sampling-Efficient Maintenance Scheduling of Multi-Component System

Unlocking the Flexibility of District Heating Pipeline Energy Storage with Reinforcement Learning

Online Prediction-Assisted Safe Reinforcement Learning for Electric Vehicle Charging Station Recommendation in Dynamically Coupled Transportation-Power Systems

Network Resource Allocation Algorithm Using Reinforcement Learning Policy-Based Network in a Smart Grid Scenario

Predictive scheduling of wet flue gas desulfurization system based on reinforcement learning

Distributional Reinforcement Learning for Scheduling of Chemical Production Processes