Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Multiple Model Adaptive Tracking Control Based on Adaptive Dynamic Programming

Multiple set-points tracking control method based on adaptive dynamic programming

Multiple Set-Points Tracking Control Based on Online ADP

Multiple Model-Based Event-Triggered Adaptive Control of a Class of Discrete-Time Nonlinear Systems.

Adaptive Control Using Multiple Parallel Dynamic Neural Networks

ADP Based Optimal Tracking Control for a Class of Linear Discrete-Time System with Multiple Delays.

Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming

Multiple Model Adaptive Control for a Class of Nonlinear Systems with Unknown Control Directions.

Tracking Control of Discrete-Time System with Dynamic Event-Based Adaptive Dynamic Programming

Online Optimal Tracking Control of Continuous-Time Linear Systems with Unknown Dynamics by Using Adaptive Dynamic Programming

Online Optimal Regulation and Tracking Control of Nonlinear Discrete-Time System with Control Constraints

Optimal Tracking Control for Constrained Two-Link Robot Based on Adaptive Dynamic Programming

Trajectory Tracking of Nonlinear System Using Multiple Series-Parallel Dynamic Neural Networks

Optimal prescribed performance tracking control of nonlinear motor driven systems via adaptive dynamic programming

Adaptive dynamic programming enhanced admittance control for robots with environment interaction and actuator saturation

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Model-free optimal control design for a class of linear discrete-time systems with multiple delays using adaptive dynamic programming.

Single‐network ADP for solving optimal event‐triggered tracking control problem of completely unknown nonlinear systems

Nonlinear adaptive control using multiple models and dynamic neural networks.

Multiple model adaptive control of system with bounded disturbance based on dynamic optimization of model set

Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method