Online accelerated data‐driven learning for optimal feedback control of discrete‐time partially uncertain systems

Luke Somers,Wassim M. Haddad,Nick‐Marios T. Kokolakis,Kyriakos G. Vamvoudakis
DOI: https://doi.org/10.1002/acs.3729
IF: 3.369
2023-12-12
International Journal of Adaptive Control and Signal Processing
Abstract:Summary In this paper, we develop an online learning algorithm for solving the Bellman equation for affine in the control discrete‐time nonlinear uncertain dynamical systems. To ensure accelerated learning of our algorithm in generating optimal control policies, we use an actor‐critic structure predicated on higher‐order tuner laws. More specifically, we construct a Nesterov‐like architecture involving momentum‐based learning laws leading to an accelerated convergence of the optimal control policy. The proposed online learning‐based optimal control framework guarantees uniform ultimate boundedness of the closed‐loop system under the assumption that the system is persistently excited. Finally, two illustrative numerical examples are provided to demonstrate the efficacy of the proposed approach.
automation & control systems,engineering, electrical & electronic
What problem does this paper attempt to address?