Abstract:Neural networks have shown great success in many machine learning related tasks, due to their ability to act as general function approximators. Recent work has demonstrated the effectiveness of neural networks in control systems (known as neural feedback loops), most notably by using a neural network as a controller. However, one of the big challenges of this approach is that neural networks have been shown to be sensitive to adversarial attacks. This means that, unless they are designed properly, they are not an ideal candidate for controllers due to issues with robustness and uncertainty, which are pivotal aspects of control systems. There has been initial work on robustness to both analyse and design dynamical systems with neural network controllers. However, one prominent issue with these methods is that they use existing neural network architectures tailored for traditional machine learning tasks. These structures may not be appropriate for neural network controllers and it is important to consider alternative architectures. This paper considers rational neural networks and presents novel rational activation functions, which can be used effectively in robustness problems for neural feedback loops. Rational activation functions are replaced by a general rational neural network structure, which is convex in the neural network's parameters. A method is proposed to recover a stabilising controller from a Sum of Squares feasibility test. This approach is then applied to a refined rational neural network which is more compatible with Sum of Squares programming. Numerical examples show that this method can successfully recover stabilising rational neural network controllers for neural feedback loops with non-linear plants with noise and parametric uncertainty.

What problem does this paper attempt to address?

The paper attempts to address the problem of improving robustness and stability in neural network controllers. Specifically, the authors point out that while neural networks perform excellently in many machine learning tasks, they face some challenges when used as controllers in control systems, particularly issues of sensitivity and robustness to adversarial attacks. Traditional activation functions (such as ReLU, sigmoid, and tanh) may not be suitable for neural network controllers because they can lead to conservative robustness certificates and are difficult to optimize when dealing with nonlinear systems. The main contributions of the paper include: 1. Proposing novel rational activation functions that can effectively approximate traditional sigmoid and tanh activation functions and perform well in analyzing neural feedback loops containing these activation functions. 2. Considering a general neural network structure based on convex form equations, demonstrating how this form of neural network is similar to feedforward neural networks with rational activation functions. 3. Introducing a new convex Sum of Squares (SOS) program to recover stable controllers for nonlinear systems by solving the SOS feasibility test. 4. Extending this method to a general rational neural network architecture, making it more suitable for SOS programming and allowing stable controllers to be recovered from it. 5. Demonstrating through multiple examples that the proposed methods and neural network architectures can effectively recover stable controllers for unstable systems with nonlinear plants, noise, and parameter uncertainties. In summary, the paper aims to overcome the limitations of existing methods by introducing rational activation functions and improved neural network structures, thereby enhancing the robustness and stability of neural network controllers in practical control systems.

Rational Neural Network Controllers

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Smart neural control of uncertain non-linear systems

A Novel Stabilizing Control for Neural Nonlinear Systems with Time Delays by State and Dynamic Output Feedback

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Structured Neural-PI Control with End-to-End Stability and Output Tracking Guarantees

Validation of Neural Network Controllers for Uncertain Systems Through Keep-Close Approach: Robustness Analysis and Safety Verification

Neural network optimal feedback control with enhanced closed loop stability

An ISS-modular Approach for Adaptive Neural Control of Pure-Feedback Systems

Robust Decentralized Adaptive Neural Control for a Class of Nonaffine Nonlinear Large-Scale Systems with Unknown Dead Zones

Robust adaptive neural network control for strict-feedback nonlinear systems via small-gain approaches

Design of Robust Adaptive Neural Switching Controller for Robotic Manipulators with Uncertainty and Disturbances

Adaptive Neural Network Finite-Time Control for Multi-Input and Multi-Output Nonlinear Systems With Positive Powers of Odd Rational Numbers

Event-Triggered Neural-Network Adaptive Control for Strict-Feedback Nonlinear Systems: Selections on Valid Compact Sets

Neural Network Adaptive Robust Control of Nonlinear Systems in Semi-Strict Feedback Form

Neural network-based adaptive robust control of a class of nonlinear systems in normal form

Backstepping Design of Adaptive Neural Fault-Tolerant Control for MIMO Nonlinear Systems.

NN/RISE-based Controller Design for a Class of Uncertain Nonlinear Systems with Time-Varying Constraints.

Neural Network Algorithm for Stabilizing Control of Robustness in Systems

Pattern-based NN Control for Uncertain Pure-Feedback Nonlinear Systems.