Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Multiple set-points tracking control method based on adaptive dynamic programming

Adaptive Extended State Space Predictive Control for a Kind of Nonlinear Systems.

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Decentralized optimal tracking control for large-scale nonlinear systems with tracking error constraints

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Multiple Model-Based Event-Triggered Adaptive Control of a Class of Discrete-Time Nonlinear Systems.

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Fast and Accurate Tracking Control of Robotic Manipulators Subject to State Constraints and Input Saturation by Effectively Integrating Planning Strategies

Time Delay System Tracking Control Based on ADP Iterative Algorithm

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

Further Results on Optimal Tracking Control for Nonlinear Systems with Nonzero Equilibrium Via Adaptive Dynamic Programming

Adaptive Dynamic Programming for Robust Event-Driven Tracking Control of Nonlinear Systems With Asymmetric Input Constraints

Finite‐Horizon Ε‐optimal Tracking Control of Discrete‐Time Linear Systems Using Iterative Approximate Dynamic Programming

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems

Adaptive dynamic programming for optimal control of discrete‐time nonlinear system with state constraints based on control barrier function

Adaptive Neural Control of Stochastic Nonlinear Time-Delay Systems With Multiple Constraints.

Optimal Tracking Control for a Class of Unknown Discrete-time Systems with Actuator Saturation Via Data-based ADP Algorithm

Near optimal tracking control of a class of nonlinear systems and an experimental comparison

Adaptive Event-Triggered Control for Nonlinear Systems with Asymmetric State Constraints: A Prescribed-Time Approach