Abstract:The gasoline inline blending process has widely used real-time optimization techniques to achieve optimization objectives, such as minimizing the cost of production. However, the effectiveness of real-time optimization in gasoline blending relies on accurate blending models and is challenged by stochastic disturbances. Thus, we propose a real-time optimization algorithm based on the Soft Actor-Critic deep reinforcement learning strategy to optimize gasoline blending without relying on a single blending model and to be robust against disturbances. Our approach constructs the environment using nonlinear blending models and feedstocks with disturbances. The algorithm incorporates the Lagrange multiplier and path constraints in reward design to manage sparse product constraints. Carefully abstracted states facilitate algorithm convergence, and the normalized action vector in each optimization period allows the agent to generalize to some extent across different target production scenarios. Through these well-designed components, the algorithm based on the Soft Actor-Critic outperforms real-time optimization methods based on either nonlinear or linear programming. It even demonstrates comparable performance with the time-horizon based real-time optimization method, which requires knowledge of uncertainty models, confirming its capability to handle uncertainty without accurate models. Our simulation illustrates a promising approach to free real-time optimization of the gasoline blending process from uncertainty models that are difficult to acquire in practice. Graphical abstract Download : Download high-res image (248KB) Download : Download full-size image

A Scenario-Based Chance-Constrained Program for Gasoline Blending under Uncertainty

Optimization of refinery hydrogen network based on chance constrained programming

Optimizing Crude Oil Operations under Uncertainty

Optimization of Short-Time Gasoline Blending Scheduling Problem with a DNA Based Hybrid Genetic Algorithm

Generalized Predictive Control For A Precise Crude Oil Blending Process

DMC-expert control of gasoline in-line blending processes

The Gasoline Pipeline Blending System Based on Expert Fuzzy Control

Non-convex chance-constrained optimization for blending recipe design under uncertainties

On-line Optimization Model Design of Gasoline Blending System under Parametric Uncertainty

A deep reinforcement learning approach to gasoline blending real-time optimization under uncertainty

ON-LINE OIL BLENDING BASED ON KALMAN PREDICTION

A ROBUST OPTIMIZATION MODEL FOR GASOLINE BLENDING SCHEDULING UNDER UNCERTAINTY

Neuro-Internal Model Based Optimal Control for Gasoline Blending Processes

Planning under Demand and Yield Uncertainties in an Oil Supply Chain

Modified Hybrid Strategy Integrating Online Adjustable Oil Property Characterization and Data-Driven Robust Optimization under Uncertainty: Application in Gasoline Blending

Robust Optimization of Hydrogen Network

Efficient Hybrid Strategy for Simultaneous Design of Refinery Hydrogen Networks and Pressure Swing Adsorption Unit

Balancing Between Risk and Profit in Refinery Hydrogen Networks: A Worst-Case Conditional Value-at-Risk Approach

Mixed-Integer Linear Programming Model for Gasoline Blending and Distribution Scheduling

Reinforcement Learning Based Gasoline Blending Optimization: Achieving More Efficient Nonlinear Online Blending of Fuels