Abstract:Motivated by the growing use of Artificial Intelligence (AI) tools in control design, this paper takes the first steps towards bridging the gap between results from Direct Gradient methods for the Linear Quadratic Regulator (LQR), and neural networks. More specifically, it looks into the case where one wants to find a Linear Feed-Forward Neural Network (LFFNN) feedback that minimizes a LQR cost. This paper starts by computing the gradient formulas for the parameters of each layer, which are used to derive a key conservation law of the system. This conservation law is then leveraged to prove boundedness and global convergence of solutions to critical points, and invariance of the set of stabilizing networks under the training dynamics. This is followed by an analysis of the case where the LFFNN has a single hidden layer. For this case, the paper proves that the training converges not only to critical points but to the optimal feedback control law for all but a set of measure-zero of the initializations. These theoretical results are followed by an extensive analysis of a simple version of the problem (the ``vector case''), proving the theoretical properties of accelerated convergence and robustness for this simpler example. Finally, the paper presents numerical evidence of faster convergence of the training of general LFFNNs when compared to traditional direct gradient methods, showing that the acceleration of the solution is observable even when the gradient is not explicitly computed but estimated from evaluations of the cost function.

Convergence Analysis of Inverse Iterative Neural Networks with L2 Penalty

Convergence Analysis of Inverse Iterative Neural Networks with L

Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

Convergence Analysis of an Incremental Approach to Online Inverse Reinforcement Learning

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Convergence and monotonicity of an online gradient method with penalty for neural networks

Convergence Analysis of Multilayer Feedforward Networks Trained with Penalty Terms: A review

Convergence Analyses on Sparse Feedforward Neural Networks Via Group Lasso Regularization.

Convergence of an online gradient method with inner-product penalty and adaptive momentum

Convergence of A Gradient Algorithm with Penalty for Training Two-Layer Neural Networks

Convergence Analysis of Overparametrized LQR Formulations

Convergence of a modified gradient-based learning algorithm with penalty for single-hidden-layer feed-forward networks

Boundedness and Convergence of Online Gradient Method with Penalty for Linear Output Feedforward Neural Networks

Notes on a Neural Network Approach to Inverse Variational Inequalities

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks

Solving an Inverse Source Problem by Deep Neural Network Method with Convergence and Error Analysis

Convergence of online gradient method for feedforward neural networks with smoothing L 1/2 regularization penalty

Boundedness and Convergence of Batch Back-Propagation Algorithm with Penalty for Feedforward Neural Networks

Convergence analysis of wide shallow neural operators within the framework of Neural Tangent Kernel

Convergence of a Gradient-Based Learning Algorithm with Penalty for Ridge Polynomial Neural Networks.