Abstract:Reinforcement learning (RL) is an artificial intelligence algorithm that can learn adaptive optimal control law online. In view of the fact that the previous control approaches were usually overly dependent on the model parameters of system, and most existing RL methods are based on state feedback, their application in actual industrial production is limited. Additionally, developing accurate process system models and ensuring the closed-loop system’s control performance is more challenging, as modern businesses place a premium on product quality and economic efficiency. As a result, this work introduces a novel data-driven two-dimensional (2D) off-policy Q -learning method based on output feedback is used to achieve optimal tracking control for batch process. First, the error between the actual output and the given set-point is extended to the system to ensure the good tracking performance. Second, by analyzing the relationship between the value function and the Q -function obtained from the 2D system’s performance index, the 2D Bellman equation is obtained in terms of output feedback that is independent of the model parameters. The optimal control problem can be effectively solved by the proposed method in this paper when the policy iteration is executed using only the measurement data of system along the batch and time directions. Following that, the proposed approach’s unbiasedness and convergence are strictly confirmed. Finally, the simulation results for the injection molding process demonstrate that the proposed method is capable of determining the optimal control law as the number of batches is growing increasingly.

Optimal tracking control of batch processes with time-invariant state delay: Adaptive Q-learning with two-dimensional state and control policy

Optimal Tracking Control of Nonlinear Batch Processes with Unknown Dynamics Using Two-Dimensional Off-Policy Interleaved Q-learning Algorithm

Novel data-driven two-dimensional Q-learning for optimal tracking control of batch process with unknown dynamics

Novel two-dimensional off-policy Q -learning method for output feedback optimal tracking control of batch process with unknown dynamics

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Two-dimensional model-free Q-learning-based output feedback fault-tolerant control for batch processes

Iterative Learning Control for a Class of Nonlinear Batch Processes with State Delay

2D Terminal Constrained Model Predictive Iterative Learning Control of Batch Processes with Time Delay.

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Improved Model-Free H∞ Control for Batch Processes Via Off-Policy 2D Game Q-learning

Off-policy two-dimensional reinforcement learning for optimal tracking control of batch processes with network-induced dropout and disturbances

2D Constrained Iterative Learning Predictive Fault Tolerant Control for Batch Processes with State Delay

Robust two-dimensional iterative learning control for batch processes with state delay and time-varying uncertainties

A Hybrid 2D Fault-Tolerant Controller Design for Multi-Phase Batch Processes with Time Delay

Data-Efficient Constrained Learning for Optimal Tracking of Batch Processes

Model-Free Optimal Tracking Design With Evolving Control Strategies via Q-Learning

Terminal Constrained Robust Hybrid Iterative Learning Model Predictive Control for Complex Time-Delayed Batch Processes

Delay-range-dependent robust 2D iterative learning control for batch processes with state delay and uncertainties

Probabilistic Tracking Control for Non-Gaussian Stochastic Process Using Novel Iterative Learning Algorithms

Nonlinear Neuro-Optimal Tracking Control via Stable Iterative Q-Learning Algorithm

Adaptive Finite-Time-Based Neural Optimal Control of Time-Delayed Wheeled Mobile Robotics Systems