Abstract:While ensuring stability for linear systems is well understood, it remains a major challenge for nonlinear systems. A general approach in such cases is to compute a combination of a Lyapunov function and an associated control policy. However, finding Lyapunov functions for general nonlinear systems is a challenging task. To address this challenge, several methods have been proposed that represent Lyapunov functions using neural networks. However, such approaches either focus on continuous-time systems, or highly restricted classes of nonlinear dynamics. We propose the first approach for learning neural Lyapunov control in a broad class of discrete-time systems. Three key ingredients enable us to effectively learn provably stable control policies. The first is a novel mixed-integer linear programming approach for verifying the discrete-time Lyapunov stability conditions, leveraging the particular structure of these conditions. The second is a novel approach for computing verified sublevel sets. The third is a heuristic gradient-based method for quickly finding counterexamples to significantly speed up Lyapunov function learning. Our experiments on four standard benchmarks demonstrate that our approach significantly outperforms state-of-the-art baselines. For example, on the path tracking benchmark, we outperform recent neural Lyapunov control baselines by an order of magnitude in both running time and the size of the region of attraction, and on two of the four benchmarks (cartpole and PVTOL), ours is the first automated approach to return a provably stable controller. Our code is available at: <a class="link-external link-https" href="https://github.com/jlwu002/nlc_discrete" rel="external noopener nofollow">this https URL</a>.

Neural Lyapunov Control for Power System Transient Stability: A Deep Learning-Based Approach

Lyapunov-Regularized Reinforcement Learning for Power System Transient Stability

An Improved Neural Lyapunov Method for Transient Stability Assessment of Networked Microgrids

Adaptive Non-Linear Neural Control of Wide-Area Power Systems

Analytic Deep Learning and Stepwise Integrated Gradients-based Power System Transient Stability Preventive Control

Neural Lyapunov Control for Discrete-Time Systems

Neural Predictor-Based Dynamic Surface Predictive Control for Power Converters

Reinforcement learning for distributed transient frequency control with stability and safety guarantees

Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guarantees

Coordinated Control of Power System Based on Direct Neural Dynamic Programming Method

An Imitation Learning-based Approach for Power System Transient Stability Emergency Control

A Stability Based Neural Networks Controller Design Method

Deep Learning-Driven Evolutionary Algorithm for Power System Voltage Stability Control

A framework of learning controller with Lyapunov-based constraint and application

Coordinated Preventive-Corrective Control for Power System Transient Stability Enhancement Based on Machine Learning-assisted Optimization

Emergency Control Methods for Power Systems Based on Improved Deep Reinforcement Learning

Application of intelligent control based on neural networks in power system

Research on Power System Transient Stability Assessment Based on Deep Learning of Big Data Technique

New Lyapunov Function for Transient Stability Analysis and Control of Power Systems with Excitation Control

Adaptive Lyapunov Function Method for Power System Transient Stability Analysis