Abstract:While ensuring stability for linear systems is well understood, it remains a major challenge for nonlinear systems. A general approach in such cases is to compute a combination of a Lyapunov function and an associated control policy. However, finding Lyapunov functions for general nonlinear systems is a challenging task. To address this challenge, several methods have been proposed that represent Lyapunov functions using neural networks. However, such approaches either focus on continuous-time systems, or highly restricted classes of nonlinear dynamics. We propose the first approach for learning neural Lyapunov control in a broad class of discrete-time systems. Three key ingredients enable us to effectively learn provably stable control policies. The first is a novel mixed-integer linear programming approach for verifying the discrete-time Lyapunov stability conditions, leveraging the particular structure of these conditions. The second is a novel approach for computing verified sublevel sets. The third is a heuristic gradient-based method for quickly finding counterexamples to significantly speed up Lyapunov function learning. Our experiments on four standard benchmarks demonstrate that our approach significantly outperforms state-of-the-art baselines. For example, on the path tracking benchmark, we outperform recent neural Lyapunov control baselines by an order of magnitude in both running time and the size of the region of attraction, and on two of the four benchmarks (cartpole and PVTOL), ours is the first automated approach to return a provably stable controller. Our code is available at: <a class="link-external link-https" href="https://github.com/jlwu002/nlc_discrete" rel="external noopener nofollow">this https URL</a>.

Approximation And Inverse Control Of Nonlinear System Using Standard Continuous Piecewise Linear Neural Networks

Nonlinear Predictive Control With Error Compensation Based On Neural Network

Inverse System Method for Internal Model Control Based on Piecewise-Linear Neural Networks

Neural Network Based Multi-Step Predictive Control for Nonlinear Systems

Identification Algorithm for Standard Continuous Piecewise Linear Neural Network

Constructive PWL Neural Network Approximation

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Configuration of Continuous Piecewise-Linear Neural Networks

Neural-model based robust H/sub /spl infin// controllers for discrete-time nonlinear systems: an BMI approach

Inverse Optimal Adaptive Neural Control for State-Constrained Nonlinear Systems

Optimization-based Adaptive Neural Sliding Mode Control for Nonlinear Systems with Fast and Accurate Response under State and Input Constraints

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

A New Neural Network Model And Its Application

Nonlinear system identification with continuous piecewise linear neural network

A Sparse Neural Network-Based Control Method for Saturated Nonlinear Affine Systems

Decentralized Adaptive Neural Inverse Optimal Control of Nonlinear Interconnected Systems

Neural Network Boundary Approximation for Uncertain Nonlinear Spatiotemporal Systems and Its Application of Tracking Control

An Adaptive Control Scheme Based on Non-Interference Nonlinearity Approximation for a Class of Nonlinear Cascaded Systems and Its Application to Flexible Joint Manipulators

Stable Adaptive Control for Nonlinear Systems Using Neural Networks

Piecewise Linear Approximation and Its Application in Model Predictive Control

Neural Lyapunov Control for Discrete-Time Systems