Abstract:In almost all industrial processes, the development of an accurate mathematical model that comprehensively characterizes the regulated system poses a substantial obstacle. Diverse factors, such as unidentified system components and time-varying external disturbances, contribute to this phenomenon. This can result in a disparity between the model and the plant and thereby compromising the performance of the designed controller. In this study, a novel data-driven ensemble optimal compensation control framework is proposed for partially known nonlinear systems with state delays and structural disturbances. Initially, the estimated system model is leveraged to construct a robust fuzzy model predictive controller (RFMPC) based on the Lyapunov-Krasovskii functional (LKF), ensuring the input-to-state stability (ISS) of the plant. Then, a reinforcement learning (RL)-based compensator is assembled to gradually minimize the model-plant mismatch across the entire state space. To streamline the training process of the compensator and facilitate its stability, a dynamic network update scheme is devised, incorporating a moving average gradient calculation method and a learning rate tuning strategy. Furthermore, comparative discussions with some prevalent methods are demonstrated. With the established control framework, the performance of the RFMPC can be securely enhanced, and convergence is ensured within a narrow proximity to equilibrium, despite time-varying perturbation dynamics. By integrating this approach with deep learning (DL) methods, the efficacy of numerous industrial processes could be significantly improved. A numerical simulation and a discretized continuous-time stirring tank reactor (CSTR) example validate the effectiveness and benefits of the proposed control strategy.

Reinforcement Learning-Based Composite Optimal Operational Control of Industrial Systems with Multiple Unit Devices

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

New Methods for Optimal Operational Control of Industrial Processes Using Reinforcement Learning on Two Time Scales

GA Based Decomposition of Large Scale Distributed Model Predictive Control Systems

A Retrofit Hierarchical Architecture for Real-Time Optimization and Control Integration

Multi-Rate Layered Operational Optimal Control for Large-Scale Industrial Processes

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Reinforcement learning‐based composite suboptimal control for Markov jump singularly perturbed systems with unknown dynamics

Off-Policy Reinforcement Learning: Optimal Operational Control for Two-Time-Scale Industrial Processes.

Decentralized Composite Suboptimal Control for a Class of Two-Time-scale Interconnected Networks with Unknown Slow Dynamics.

Reinforcement Learning Based Data-driven Optimal Control Strategy for Systems with Disturbance

Data-driven Ensemble Optimal Compensation Control for Partially Known Delayed and Persistently Disturbed Nonlinear Systems

Dual-Rate Operational Optimal Control for Flotation Industrial Process With Unknown Operational Model

Incremental Reinforcement Learning and Optimal Output Regulation under Unmeasurable Disturbances

Adaptive Optimal Output Regulation of Interconnected Singularly Perturbed Systems with Application to Power Systems

Reinforcement learning for optimal tracking of large-scale systems with multitime scales

Model-Based Cross-Scale Reinforcement Learning Optimal Control

Dynamic Optimal Operational Control for Complex Systems with Nonlinear External Loop Disturbances

Data-Driven Solutions to Mixed $h_{2}/h_{\infty}$ Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach.

Composite Adaptive Online Inverse Optimal Control Approach to Human Behavior Learning