Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Model-free Adaptive Dynamic Event-Triggered Robust Control for Unknown Nonlinear Systems Using Iterative Neural Dynamic Programming

Novel iterative neural dynamic programming for data-based approximate optimal control design

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Model-Free Incremental Adaptive Dynamic Programming Based Approximate Robust Optimal Regulation

Adaptive neural event‐triggered near‐optimal control for affined uncertain nonlinear discrete‐time system

Optimal tracking control for unknown nonlinear systems with uncertain input saturation: A dynamic event-triggered ADP algorithm

Single‐network ADP for solving optimal event‐triggered tracking control problem of completely unknown nonlinear systems

Robust adaptive dynamic programming for optimal nonlinear control design

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Guaranteed cost tracking control of constrained input nonlinear uncertain systems using event-based ADP

Robust ADP Design for Continuous-Time Nonlinear Systems with Output Constraints

Output information-based intermittent optimal control for continuous-time nonlinear systems with unmatched uncertainties via adaptive dynamic programming

Functional cast-bracing for Colles' fractures. A comparison between cast-bracing and conventional plaster casts.

Event-Based Robust Control for Uncertain Nonlinear Systems Using Adaptive Dynamic Programming

Angle-dependent high-order harmonic generation from a single N2 and O2 molecule

Dynamic Event-Triggered Prescribed Performance Control for Partially Unknown Nonlinear System via Adaptive Dynamic Programming

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Event‐triggered adaptive estimated inverse neural network control of uncertain nonlinear systems with unknown hysteresis effects

Event-Triggered Single-Network ADP for Zero-Sum Game of Unknown Nonlinear Systems with Constrained Input