Invariant Set Estimation for Piecewise Affine Dynamical Systems Using Piecewise Affine Barrier Function

Pouya Samanipour,Hasan A.Poonawala

2024-02-07

Abstract:This paper introduces an algorithm for approximating the invariant set of closed-loop controlled dynamical systems identified using ReLU neural networks or piecewise affine PWA functions, particularly addressing the challenge of providing safety guarantees for ReLU networks commonly used in safety-critical applications. The invariant set of PWA dynamical system is estimated using ReLU networks or its equivalent PWA function. This method entails formulating the barrier function as a PWA function and converting the search process into a linear optimization problem using vertices. We incorporate a domain refinement strategy to increase flexibility in case the optimization does not find a valid barrier function. Moreover, the objective of optimization is to maximize the invariant set based on the current partition. Our experimental results demonstrate the effectiveness and efficiency of our approach, demonstrating its potential for ensuring the safety of PWA dynamical systems.

Systems and Control

What problem does this paper attempt to address?

### Problems the paper attempts to solve

The paper aims to solve the problem of how to estimate the forward invariant set of piece - wise affine (PWA) dynamical systems or their equivalent ReLU neural networks. Specifically, the paper proposes an algorithm for approximating the invariant sets of dynamical systems under closed - loop control, which are identified by ReLU neural networks or piece - wise affine functions. The paper particularly focuses on the challenge of providing safety guarantees for ReLU networks commonly used in safety - critical applications.

### Main contributions

1. **Framework introduction**: A new framework is proposed that does not rely on traditional verification procedures to determine the forward invariant set of PWA dynamical systems or ReLU neural networks.
2. **Barrier function representation**: Represent the barrier function as a PWA function with a structure similar to that of the dynamical system, and represent the constraint conditions as linear equations.
3. **Algorithm improvement**: Add a refinement step to enhance the flexibility of the algorithm by using a higher - capacity PWA barrier function.

### Method overview

1. **Definitions and notations**:
- **Forward invariant set**: For a general controlled nonlinear dynamical system, if a set \( C \) satisfies that the solution \( x(t) \) of the initial condition \( x_0\in C \) belongs to \( C \) for all \( t\in I(x_0) \), then \( C \) is called a forward invariant set.
- **Barrier function**: If there exists an extended class \( K_\infty \) function \( \alpha \) such that \( L_fh(x)\geq - \alpha(h(x)) \) holds for all \( x\in D \), then \( h(x) \) is called a barrier function.

2. **PWA function representation**:
- The piece - wise affine function \( \text{PWA}(x) \) can be represented as \( \text{PWA}(x)=A_ix + a_i \), where \( x\in X_i \).
- \( X_i \) is a polyhedron defined by the inequality \( E_ix + e_i\geq 0 \).

3. **Optimization problem**:
- Construct an optimization problem to find the invariant set, with the objective of minimizing the sum of slack variables \( \tau_b \) and \( \tau_{int} \).
- The constraint conditions include the non - positivity of the barrier function on the boundary, the positivity of the internal vertices, and the satisfaction of the generalized Nagumo condition.

4. **Refinement process**:
- If the optimization problem fails to find a valid barrier function, the capacity of the PWA barrier function can be increased by refining the cells.
- The refinement process includes selecting new vertices and using Delaunay triangulation to form sub - cells.

### Experimental results

The paper provides three examples to verify the effectiveness and efficiency of the proposed algorithm:

1. **Inverted pendulum system**:
- The dynamical system is described as \( \dot{x}_1 = x_2 \) and \( \dot{x}_2=\sin(x_1)+u \).
- Use a ReLU neural network to approximate the dynamics and find the forward invariant set through the algorithm.
- The results show that the algorithm can effectively find the invariant set and display the changes in sample trajectories and barrier function values.

2. **Explicit model predictive controller**:
- Consider a discrete - time linear dynamical system and design a control strategy using the model predictive control (MPC) method.
- Verify the invariant set of the continuous - form dynamical system through the algorithm and show the visualization results of the invariant set.

3. **4D example**:
- Explore a 4D model predictive control scenario and verify the performance of the algorithm in high - dimensional systems.

### Conclusion

The paper proposes a new framework and algorithm for estimating the forward invariant set of piece - wise affine dynamical systems, especially for ReLU neural networks used in safety - critical applications. Through the optimization problem and the refinement process, the algorithm can effectively find the largest forward invariant set while ensuring safety. The experimental results verify...