Abstract:Previous chapter Next chapter Advances in Design and Control Control Perspectives on Numerical Algorithms and Matrix Problems4. Neural-Gradient Dynamical Systems for Linear and Quadratic Programming Problemspp.127 - 177Chapter DOI:https://doi.org/10.1137/1.9780898718669.ch4PDFBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAboutExcerpt At first glance, Liapunov's works were not related to optimization. However, this is not exactly the case. Liapunov developed stability theory for ordinary differential equations; in its simplest form it states that a solution x (t) of the equation x˙ = f (x) is stable if there exists a function V (x) (the Liapunov function) such that 〈∇ V (x), f (x)〉 < 0. We can take a reverse point of view: the differential equation above is a continuous-time method for minimizing V (x). Thus the method provides a systematic tool for validation of the convergence of numerical methods of optimization. —B. T. Polyak [Pol02] This chapter develops the point of view advocated in the quote above, adding the ingredients of control parameters and control Liapunov functions. From the perspective of Chapter 2, continuous algorithms developed in this chapter for finding extrema of functions are given in the form of ODEs whose equilibria are identical with the extrema being sought. In fact, linear and quadratic programming problems are solved using the class of ODEs called gradient dynamical systems (GDSs). These optimization problems are transformed into unconstrained optimization problems using exact penalty functions, which are then solved using a gradient descent method, i.e., a GDS. The key idea is to adjust the penalty parameters, interpreted as control parameters, in the resulting GDS, using a control Liapunov function (CLF) approach. Since the system being studied is a GDS, the energy or potential function whose gradient defines the right-hand side (of the GDS) is a natural Liapunov function. The fact that these GDFSs can be represented and implemented as a class of recurrent neural networks explains the neologism neural-gradient dynamical systems that occurs in the chapter title, essentially to call the reader's attention to the equivalence between a GDS approach to optimization and the recurrent neural network approach. Anovelty that arises in the approach presented in this chapter is that nonsmooth CLFs have to be used since exact penalty functions are nonsmooth (i.e., have finitely many points of nondifferentiability). This technicality is handled using a generalized Persidskii-type result, presented in Chapter 1, that allows the treatment of a class of differential equations with discontinuous right-hand sides. Previous chapter Next chapter RelatedDetails Published:2006ISBN:978-0-89871-602-3eISBN:978-0-89871-866-9 https://doi.org/10.1137/1.9780898718669Book Series Name:Advances in Design and ControlBook Code:DC10Book Pages:xxv + 265Key words:Control theory, system theory, iterative methods, numerical methods for ODEs, Liapunov functions, gradient dynamical systems

Design of Second Order Neural Networks As Dynamical Control Systems That Aim to Minimize Nonconvex Scalar Functions

Unified Control Liapunov Function Based Design of Neural Networks That Aim at Global Minimization of Nonconvex Functions

The Controlled Conjugate Gradient Type Trajectory-Following Neural Net for Minimization of Nonconvex Functions.

Neural-Gradient Dynamical Systems for Linear and Quadratic Programming Problems

Comparative Study of the CG and HBF ODEs Used in the Global Minimization of Nonconvex Functions

Systematic construction of continuous-time neural networks for linear dynamical systems

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Neural Control: Concurrent System Identification and Control Learning with Neural ODE

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Control Liapunov function design of neural networks that solve convex optimization and variational inequality problems

Adaptive Neural Control for a Class of Pure-Feedback Nonlinear Systems Via Dynamic Surface Technique

Dynamic Learning from Adaptive Neural Network Control of a Class of Nonaffine Nonlinear Systems

Dynamic Output Feedback Stabilization for Nonlinear Systems Based on Standard Neural Network Models

Constrained Neural Ordinary Differential Equations with Stability Guarantees

Stabilizing Controllers For Nonlinear Systems Based On Standard Neural Network Models

Neural networks for nonconvex nonlinear programming problems: a switching control approach

Differential neural network robust constrained controller using approximate dynamic programming

Adaptive Neural Network Control for a Class of Nonlinear Systems With Function Constraints on States

Adaptive output feedback control system design for nonlinear systems via neural networks

Near-optimal control of dynamical systems with neural ordinary differential equations