Abstract:In the context of intelligent manufacturing in the process industry, traditional model-based optimization control methods cannot adapt to the situation of drastic changes in working conditions or operating modes. Reinforcement learning (RL) directly achieves the control objective by interacting with the environment, and has significant advantages in the presence of uncertainty since it does not require an explicit model of the operating plant. However, most RL algorithms fail to retain transfer learning capabilities in the presence of mode variation, which becomes a practical obstacle to industrial process control applications. To address these issues, we design a framework that uses local data augmentation to improve the training efficiency and transfer learning (adaptability) performance. Therefore, this paper proposes a novel RL control algorithm, CBR-MA-DDPG, organically integrating case-based reasoning (CBR), model-assisted (MA) experience augmentation, and deep deterministic policy gradient (DDPG). When the operating mode changes, CBR-MA-DDPG can quickly adapt to the varying environment and achieve the desired control performance within several training episodes. Experimental analyses on a continuous stirred tank reactor (CSTR) and an organic Rankine cycle (ORC) demonstrate the superiority of the proposed method in terms of both adaptability and control performance/robustness. The results show that the control performance of the CBR-MA-DDPG agent outperforms the conventional PI and MPC control schemes, and that it has higher training efficiency than the state-of-the-art DDPG, TD3, and PPO algorithms in transfer learning scenarios with mode shift situations.

Deep Reinforcement Learning-Based Process Control in Biodiesel Production

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

Nonlinear Predictive Control and Online Optimization Based on Neural Network Model in Diesel Oil Blending

A Reinforcement Learning-Based Temperature Control of Fluidized Bed Reactor in Gas-Phase Polyethylene Process

Supervised integrated deep deterministic policy gradient model for enhanced control of chemical processes

A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control

Accelerating reinforcement learning with case-based model-assisted experience augmentation for process control

Model Predictive Control Guided Reinforcement Learning Control Scheme

Reinforcement learning based temperature control of a fermentation bioreactor for ethanol production

A Novel Sim2real Reinforcement Learning Algorithm for Process Control

Ai-based optimal control of fed-batch biopharmaceutical process leveraging deep reinforcement learning

Stable Predictive Control of Continuous Stirred-tank Reactors Using Deep Learning

Adaptive Adjustment of Interval Predictive Control Based on Combined Model and Application in Shell Brand Petroleum Distillation Tower

Intelligent Control Strategy for Transient Response of a Variable Geometry Turbocharger System Based on Deep Reinforcement Learning

Reinforcement learning for batch bioprocess optimization

Hierarchical MPC‐based control structure for continuous biodiesel production

Optimizing olefin purification: An artificial intelligence-based process-conscious PI controller tuning for double dividing wall column distillation

Deep Reinforcement Learning Optimized Double Exponentially Weighted Moving Average Controller for Chemical Mechanical Polishing Processes

Deep Reinforcement Learning-Pid Based Supervisor Control Method for Indirect-Contact Heat Transfer Processes in Energy Systems

Advancing Process Control in Fluidized Bed Biomass Gasification Using Model-Based Deep Reinforcement Learning