Abstract:This paper is concerned with the stability analysis problem of feedback systems with rectified linear unit (ReLU) nonlinearities. Such feedback systems arise when we model dynamical (recurrent) neural networks (NNs) and NN-driven control systems where all the activation functions of NNs are ReLUs. In this study, we focus on the semialgebraic set representation characterizing the input-output properties of ReLUs. This allows us to employ a novel copositive multiplier in the framework of the integral quadratic constraint and, thus, to derive a linear matrix inequality (LMI) condition for the stability analysis of the feedback systems. However, the infeasibility of this LMI does not allow us to obtain any conclusion on the system's stability due to its conservativeness. This motivates us to consider its dual LMI. By investigating the structure of the dual solution, we derive a rank condition on the dual variable certificating that the system at hand is never stable. In addition, we construct a hierarchy of dual LMIs allowing for improved instability detection. We illustrate the effectiveness of the proposed approach by several numerical examples.

Stability Analysis of Feedback Systems with ReLU Nonlinearities via Semialgebraic Set Representation

Stability Analysis for Discrete Linear Systems with State Saturation by a Saturation-Dependent Lyapunov Functional

Robust stabilization of feedback linearizable time-delay systems

Stability analysis and controller synthesis for discrete linear time-delay systems with state saturation nonlinearities

Robust Absolute Stability For General Neutral Type Lurie Indirect Control Systems

Stability analysis of a class of discrete-time recurrent neural networks: An LMI approach

On Dual of LMIs for Absolute Stability Analysis of Nonlinear Feedback Systems with Static O'Shea-Zames-Falb Multipliers

Stability Analysis Using Quadratic Constraints for Systems With Neural Network Controllers

A New Neural Network Model for the Feedback Stabilization of Nonlinear Systems

Stabilization by Output Feedback of Multivariable Invertible Nonlinear Systems.

Stability and Performance Analysis of Discrete-Time ReLU Recurrent Neural Networks

Revisited Criteria for Absolute Stability of Systems with State-Dependent Nonlinearities

Ensuring Both Positivity and Stability Using Sector-Bounded Nonlinearity for Systems with Neural Network Controllers

Neural network optimal feedback control with enhanced closed loop stability

Lagrange Stability of a Class of Nonlinear Discrete-time Systems

Stability Analysis of a Class of Discontinuous Discrete-Time Systems

Convex Reformulation of LMI-Based Distributed Controller Design with a Class of Non-Block-Diagonal Lyapunov Functions

Iterative, Small-Signal L2 Stability Analysis of Nonlinear Constrained Systems

On the constrained feedback linearization control based on the MILP representation of a ReLU-ANN

Stability Analysis for a Class of Nonlinear Feedback System

Stabilization of Discrete-Time Singular Markov Jump Systems With Repeated Scalar Nonlinearities