Abstract:In this paper, a learning-based predictive control (LPC) scheme is proposed for adaptive optimal control of discrete-time nonlinear systems under stochastic disturbances. The proposed LPC scheme is different from conventional model predictive control (MPC), which uses open-loop optimization or simplified closed-loop optimal control techniques in each horizon. In LPC, the control task in each horizon is formulated as a closed-loop nonlinear optimal control problem and a finite-horizon iterative reinforcement learning (RL) algorithm is developed to obtain the closed-loop optimal/suboptimal solutions. Therefore, in LPC, RL and adaptive dynamic programming (ADP) are used as a new class of closed-loop learning-based optimization techniques for nonlinear predictive control with stochastic disturbances. Moreover, LPC also decomposes the infinite-horizon optimal control problem in previous RL and ADP methods into a series of finite horizon problems, so that the computational costs are reduced and the learning efficiency can be improved. Convergence of the finite-horizon iterative RL algorithm in each prediction horizon and the Lyapunov stability of the closed-loop control system are proved. Moreover, by using successive policy updates between adjoint time horizons, LPC also has lower computational costs than conventional MPC which has independent optimization procedures between two different prediction horizons. Simulation results illustrate that compared with conventional nonlinear MPC as well as ADP, the proposed LPC scheme can obtain a better performance both in terms of policy optimality and computational efficiency.

Efficient Predictive Control Algorithm for Nonlinear Discrete Systems with Persistent Disturbances

A nonlinear predictive control algorithm based on fuzzy online modeling and discrete optimization

Adaptive Extended State Space Predictive Control for a Kind of Nonlinear Systems.

Sliding Mode Prediction Based Control Algorithm for Discrete-Time Non-Linear Uncertain Coupled Systems.

Adaptive Predictive Functional Control for a Class of Nonlinear Systems

Support Vector Machine Based Predictive Control for Nonlinear Systems

Extended State Space Predictive Control for a Class of Nonlinear Systems

Predictive Control of a Class of Bilinear Systems Based on Global Off-Line Models

An Adaptive Model Predictive Control Strategy for Discrete-Time Nonlinear System

A fast, fully distributed nonlinear model predictive control algorithm with parametric sensitivity through Jacobi iteration

An Adaptive Nonlinear Model Predictive Control Based On Online Svm Regression Algorithm

Fast cooperative distributed model predictive control based on parametric sensitivity

Robust Nonlinear Model Predictive Control Algorithm Based on Reduced Precision Solution Criteria

Improved Successive Approximation Procedure for Optimal Control of Nonlinear Systems with Disturbances

Learning-Based Predictive Control for Discrete-Time Nonlinear Systems With Stochastic Disturbances

Robust Dynamic Output Feedback Predictive Control for Discrete Uncertain Systems with Time-Varying Delays

Adaptive predictive functional control of a class of nonlinear systems based on dynamical linearization

Disturbance Prediction-Based Adaptive Event-Triggered Model Predictive Control for Perturbed Nonlinear Systems

Effective Nonlinear Predictive Control With Regional Stability

An Efficient Model Nonlinear Predictive Control Algorithm Based On Stair-Like Control Strategy

Adaptive predictive functional control of a class of nonlinear systems.