Abstract:This paper concerns the optimal control problem of a general affinely pseudo-linearized nonlinear system and puts forward the solving scheme based on adaptive dynamic programming and neural network. In detail, a new more general affinely pseudo-linearized nonlinear system model is presented and covers more practical scenarios than existing models in engineering. In consideration of the Bellman optimal principle, the corresponding model particulars are then analyzed and its adaptive dynamic programming solving scheme is derived. That is, the modified policy iteration is used to estimate the value function and optimal control at each sampled state, and then the calculated state-control pairs and state critic values are utilized to train two neural networks (one works as state evaluator and the other works as optimal control generator, respectively). Through the above, the discrete state space is smoothed into a continuous state space, and the notorious dimensional curse problem could be addressed. Moreover, in order to improve the efficiency and precision of the network training, the samples calculating and network training processes are simultaneously carried out in this paper. In the end, a related simulation experiment is applied and the results demonstrate that the proposed method has more effectiveness and validation for the optimal control problem of the newly proposed general system model than the compared methods.

Neural-network-based Near-Optimal Control for a Class of Nonlinear Descriptor Systems with Control Constraint

Greedy Iterative DHP Algorithm-Based Near-Optimal Control for a Class of Nonlinear Descriptor Systems with Actuator Saturating.

Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems with Control Constraints

Near-optimal Stabilization for a Class of Nonlinear Systems with Control Constraint Based on Single Network Greedy Iterative DHP Algorithm

Policy Iteration-Based Optimal Control Design for Nonlinear Descriptor Systems

Near-optimal control laws based on Heuristic Dynamic Programming iteration algorithm

Neural-Network-Based Constrained Optimal Control Scheme for Discrete-Time Switched Nonlinear System Using Dual Heuristic Programming

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Adaptive optimal control for nonlinear discrete-time systems

Approximate optimal tracking control for a class of discrete-time non-affine systems based on GDHP algorithm

Near-optimal Control for Continuous-Time Nonlinear Systems with Control Constraints Using On-Line ADP

Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs Using GDHP Technique

ADP-based optimal control for a class of nonlinear discrete-time systems with inequality constraints

Optimal Control Of A Class Of Non-Linear Discrete-Continuous Hybrid Systems

Intelligent Optimal Control of Constrained Nonlinear Systems Via Receding-Horizon Heuristic Dynamic Programming

Adaptive Dynamic Programming Approach on Optimal Control for Affinely Pseudo- Linearized Nonlinear System.

Neural-network-based Optimal Control for Discrete-Time Nonlinear Systems Using General Value Iteration

Nearly Finite-Horizon Optimal Control for A Class of Nonaffine Time-Delay Nonlinear Systems Based on Adaptive Dynamic Programming

Multi-objective optimal control for a class of unknown nonlinear systems based on finite-approximation-error ADP algorithm

Infinite Horizon Optimal Control of Affine Nonlinear Discrete Switched Systems Using Two-Stage Approximate Dynamic Programming

Discrete‐Time Optimal Control of State‐Constrained Nonlinear Systems Using Approximate Dynamic Programming