Abstract:While ensuring stability for linear systems is well understood, it remains a major challenge for nonlinear systems. A general approach in such cases is to compute a combination of a Lyapunov function and an associated control policy. However, finding Lyapunov functions for general nonlinear systems is a challenging task. To address this challenge, several methods have been proposed that represent Lyapunov functions using neural networks. However, such approaches either focus on continuous-time systems, or highly restricted classes of nonlinear dynamics. We propose the first approach for learning neural Lyapunov control in a broad class of discrete-time systems. Three key ingredients enable us to effectively learn provably stable control policies. The first is a novel mixed-integer linear programming approach for verifying the discrete-time Lyapunov stability conditions, leveraging the particular structure of these conditions. The second is a novel approach for computing verified sublevel sets. The third is a heuristic gradient-based method for quickly finding counterexamples to significantly speed up Lyapunov function learning. Our experiments on four standard benchmarks demonstrate that our approach significantly outperforms state-of-the-art baselines. For example, on the path tracking benchmark, we outperform recent neural Lyapunov control baselines by an order of magnitude in both running time and the size of the region of attraction, and on two of the four benchmarks (cartpole and PVTOL), ours is the first automated approach to return a provably stable controller. Our code is available at: <a class="link-external link-https" href="https://github.com/jlwu002/nlc_discrete" rel="external noopener nofollow">this https URL</a>.

Function-dependent Neural-Network-driven State Feedback Control and Self-Verification Stability for Discrete-Time Nonlinear System

A Novel Stabilizing Control for Neural Nonlinear Systems with Time Delays by State and Dynamic Output Feedback

Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation

A New Neural Network Model for the Feedback Stabilization of Nonlinear Systems

Lyapunov-stable neural-network control

Model-Free Verification for Neural Network Controlled Systems

A Stability Based Neural Networks Controller Design Method

Standard Neural Network Model for the Feedback Stabilization of Intelligent Systems

Robust controller synthesis of discrete-time intelligent systems using a standard neural network model

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Neural network optimal feedback control with enhanced closed loop stability

Neural Lyapunov Control for Discrete-Time Systems

A Neural Stabilizing Control For Discrete-Time Nonlinear Systems By Dynamic Output Feedback

Neural Network Optimal Feedback Control with Guaranteed Local Stability

Neural Network-Based Lyapunov Stability Verification for Continuous-Time Nonlinear Systems Via Mixed Integer Linear Programming

Neural Learning Control for Discrete-Time Nonlinear Systems in Pure-Feedback Form

Adaptive neural-based control for non-strict feedback systems with full-state constraints and unmodeled dynamics

Stable Adaptive Control for Nonlinear Systems Using Neural Networks

Robust Stabilising Controller Synthesis for Discrete-Time Recurrent Neural Networks Via State Feedback

Neural Network Control-Based Adaptive Learning Design for Nonlinear Systems with Full-State Constraints.

Data-Driven Stable Neural Feedback Loop Design