Abstract:Reinforcement learning (RL) is an artificial intelligence algorithm that can learn adaptive optimal control law online. In view of the fact that the previous control approaches were usually overly dependent on the model parameters of system, and most existing RL methods are based on state feedback, their application in actual industrial production is limited. Additionally, developing accurate process system models and ensuring the closed-loop system’s control performance is more challenging, as modern businesses place a premium on product quality and economic efficiency. As a result, this work introduces a novel data-driven two-dimensional (2D) off-policy Q -learning method based on output feedback is used to achieve optimal tracking control for batch process. First, the error between the actual output and the given set-point is extended to the system to ensure the good tracking performance. Second, by analyzing the relationship between the value function and the Q -function obtained from the 2D system’s performance index, the 2D Bellman equation is obtained in terms of output feedback that is independent of the model parameters. The optimal control problem can be effectively solved by the proposed method in this paper when the policy iteration is executed using only the measurement data of system along the batch and time directions. Following that, the proposed approach’s unbiasedness and convergence are strictly confirmed. Finally, the simulation results for the injection molding process demonstrate that the proposed method is capable of determining the optimal control law as the number of batches is growing increasingly.

Data-Efficient Constrained Learning for Optimal Tracking of Batch Processes

An Efficient Latent Variable Optimization Approach with Stochastic Constraints for Complex Industrial Process

Optimal tracking control of batch processes with time-invariant state delay: Adaptive Q-learning with two-dimensional state and control policy

Novel data-driven two-dimensional Q-learning for optimal tracking control of batch process with unknown dynamics

Conic Iterative Learning Control Using Distinct Data for Constrained Systems With State-Dependent Uncertainty

110Th Anniversary: an Overview on Learning-Based Model Predictive Control for Batch Processes

Optimal Iterative Learning Control for Batch Processes Based on Linear Time-varying Perturbation Model

Constrained Run-to-Run Optimization for Batch Process Based on Support Vector Regression Model

Novel two-dimensional off-policy Q -learning method for output feedback optimal tracking control of batch process with unknown dynamics

Improved Design of Constrained Model Predictive Tracking Control for Batch Processes Against Unknown Uncertainties

Batch-to-batch Optimization for Economic Performance Improvement in Batch Processes by Rational Disturbances Utilization

Optimal Iterative Learning Control for Batch Processes in the Presence of Time-Varying Dynamics

Batch-to-batch self-optimizing control for batch processes

Iterative Learning Model Predictive Control Based on Iterative Data-Driven Modeling

Trajectory tracking of batch processes with varying control interval and incrementally updated models

Synthesis of Real-Time-Feedback-Based 2D Iterative Learning Control–Model Predictive Control for Constrained Batch Processes with Unknown Input Nonlinearity

A real-time optimization approach for uncertain batch processes

Robust Iterative Learning Control for Multi-Phase Batch Processes: an Average Dwell-Time Method with 2D Convergence Indexes

Nonlinear Monotonically Convergent Iterative Learning Control for Batch Processes

Integrated Tracking Control For Batch Processes In The Presence Of Model Uncertainties

Batch process control from practice to 2D model predictive control