Abstract:The gasoline inline blending process has widely used real-time optimization techniques to achieve optimization objectives, such as minimizing the cost of production. However, the effectiveness of real-time optimization in gasoline blending relies on accurate blending models and is challenged by stochastic disturbances. Thus, we propose a real-time optimization algorithm based on the Soft Actor-Critic deep reinforcement learning strategy to optimize gasoline blending without relying on a single blending model and to be robust against disturbances. Our approach constructs the environment using nonlinear blending models and feedstocks with disturbances. The algorithm incorporates the Lagrange multiplier and path constraints in reward design to manage sparse product constraints. Carefully abstracted states facilitate algorithm convergence, and the normalized action vector in each optimization period allows the agent to generalize to some extent across different target production scenarios. Through these well-designed components, the algorithm based on the Soft Actor-Critic outperforms real-time optimization methods based on either nonlinear or linear programming. It even demonstrates comparable performance with the time-horizon based real-time optimization method, which requires knowledge of uncertainty models, confirming its capability to handle uncertainty without accurate models. Our simulation illustrates a promising approach to free real-time optimization of the gasoline blending process from uncertainty models that are difficult to acquire in practice. Graphical abstract Download : Download high-res image (248KB) Download : Download full-size image

On-line Optimization Model Design of Gasoline Blending System under Parametric Uncertainty

Optimization of Short-Time Gasoline Blending Scheduling Problem with a DNA Based Hybrid Genetic Algorithm

DMC-expert control of gasoline in-line blending processes

Neuro-Internal Model Based Optimal Control for Gasoline Blending Processes

Simultaneous design and control of polyethylene process based on uncertainty Kriging model

ON-LINE OIL BLENDING BASED ON KALMAN PREDICTION

Nonlinear Predictive Control and Online Optimization Based on Neural Network Model in Diesel Oil Blending

Optimization of refinery hydrogen network based on chance constrained programming

Optimizing Crude Oil Operations under Uncertainty

The Gasoline Pipeline Blending System Based on Expert Fuzzy Control

Robust Optimization of Hydrogen Network

Non-convex chance-constrained optimization for blending recipe design under uncertainties

A Scenario-Based Chance-Constrained Program for Gasoline Blending under Uncertainty

Efficient Hybrid Strategy for Simultaneous Design of Refinery Hydrogen Networks and Pressure Swing Adsorption Unit

Modified Hybrid Strategy Integrating Online Adjustable Oil Property Characterization and Data-Driven Robust Optimization under Uncertainty: Application in Gasoline Blending

A ROBUST OPTIMIZATION MODEL FOR GASOLINE BLENDING SCHEDULING UNDER UNCERTAINTY

A deep reinforcement learning approach to gasoline blending real-time optimization under uncertainty

Robust Engineering Strategy for Scheduling Optimization of Refinery Fuel Gas System

Robust Design and Operations of Hydrocarbon Biofuel Supply Chain Integrating with Existing Petroleum Refineries Considering Unit Cost Objective

Refinery-Wide Planning Operations Under Uncertainty Via Robust Optimization Approach Coupled With Global Optimization

Reinforcement Learning Based Gasoline Blending Optimization: Achieving More Efficient Nonlinear Online Blending of Fuels