Abstract:In this paper, the finite-horizon optimal control design for nonlinear discrete-time systems in affine form is presented. In contrast with the traditional approximate dynamic programming methodology, which requires at least partial knowledge of the system dynamics, in this paper, the complete system dynamics are relaxed utilizing a neural network (NN)-based identifier to learn the control coefficient matrix. The identifier is then used together with the actor-critic-based scheme to learn the time-varying solution, referred to as the value function, of the Hamilton-Jacobi-Bellman (HJB) equation in an online and forward-in-time manner. Since the solution of HJB is time-varying, NNs with constant weights and time-varying activation functions are considered. To properly satisfy the terminal constraint, an additional error term is incorporated in the novel update law such that the terminal constraint error is also minimized over time. Policy and/or value iterations are not needed and the NN weights are updated once a sampling instant. The uniform ultimate boundedness of the closed-loop system is verified by standard Lyapunov stability theory under nonautonomous analysis. Numerical examples are provided to illustrate the effectiveness of the proposed method.

A Quasi-Infinite Horizon Predictive Control Scheme for Constrained Nonlinear Systems

Novel Robust Predictive Control Algorithm Based on Closed-Loop Optimization

A Quasi-Infinite Horizon Nonlinear Predictive Control Scheme for Stable Systems: Application to a CSTR

Extended State Space Predictive Control for a Class of Nonlinear Systems

Decentralized Model Predictive Control of Nonlinear Continuous Systems with Contractive Constraints

Stabilizing Model Predictive Control Scheme for Piecewise Affine Systems with Maximal Positively Invariant Terminal Set

General Quasi-infinite Horizon Nonlinear Model Predictive Control

Stability of Finite Horizon Model Predictive Control with Incremental Input Constraints.

H∞ Robust Predictive Control of Nonlinear Systems with Constraints

Approximate infinite-horizon predictive control

On Infinite Time Performance of Nonlinear Model Predictive Controllers

Inherent robustness properties of quasi-infinite horizon nonlinear model predictive control.

Quasi-infinite Horizon NMPC for Nonlinear Discrete-Time Systems

Finite Horizon Model Predictive Control with Ellipsoid Mapping of Uncertain Linear Systems

Model predictive control for nonlinear systems with constraint inputs

A Dual-Mode Nonlinear Model Predictive Control Scheme With Extended Terminal Constraint Sets

Predictive Control with Probability Constraints for Linear Stochastic Systems

Suboptimality Analysis of Receding Horizon Predictive Control with Terminal Constraints

A Feasible Moving Horizon ${\cal H}_{\infty}$ Control Scheme for Constrained Uncertain Linear Systems

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

Finite-Time Stabilization for Constrained Discrete-time Systems by Using Model Predictive Control