Abstract:This paper aims to discuss and analyze the potentialities of Recurrent Neural Networks (RNN) in control design applications. The main families of RNN are considered, namely Neural Nonlinear AutoRegressive eXogenous, (NNARX), Echo State Networks (ESN), Long Short Term Memory (LSTM), and Gated Recurrent Units (GRU). The goal is twofold. Firstly, to survey recent results concerning the training of RNN that enjoy Input-to-State Stability (ISS) and Incremental Input-to-State Stability ($\delta$ISS) guarantees. Secondly, to discuss the issues that still hinder the widespread use of RNN for control, namely their robustness, verifiability, and interpretability. The former properties are related to the so-called generalization capabilities of the networks, i.e. their consistency with the underlying real plants, even in presence of unseen or perturbed input trajectories. The latter is instead related to the possibility of providing a clear formal connection between the RNN model and the plant. In this context, we illustrate how ISS and $\delta$ISS represent a significant step towards the robustness and verifiability of the RNN models, while the requirement of interpretability paves the way to the use of physics-based networks. The design of model predictive controllers with RNN as plant's model is also briefly discussed. Lastly, some of the main topics of the paper are illustrated on a simulated chemical system.

An incremental input-to-state stability condition for a generic class of recurrent neural networks

Regional stability conditions for recurrent neural network-based control systems

Input State Stability of Gated Graph Neural Networks

Mean square input-to-state stability of a general class of stochastic recurrent neural networks with Markovian switching

Input-to-state stability of recurrent neural networks with time-varying delays and Markovian switching

New Approach for Robust Stability Analysis of Delayed Recurrent Neural Networks

Improved Delay-Dependent Stability Condition of Discrete Recurrent Neural Networks with Time-Varying Delays

Less conservative stability condition for uncertain discrete-time recurrent neural networks with time-varying delays.

On Recurrent Neural Networks for learning-based control: recent results and ideas for future developments

Nonlinear MPC design for incrementally ISS systems with application to GRU networks

Improved Stability Criteria of Generalized Recurrent Neural Networks with Time-varying Delays

Further Development of Input-To-State Stabilizing Control for Dynamic Neural Network Systems

Global Robust Exponential Stability Analysis for Interval Recurrent Neural Networks

Global stability of interval recurrent neural networks

Mean-square exponential input-to-state stability of stochastic delayed neural networks

Further Results on Incremental Input-to-State Stability

Stability of A Class of RNN Controllers for First-order Uncertain Systems

New Stability and Stabilization Conditions for Stochastic Neural Networks of Neutral Type with Markovian Jumping Parameters.

Robust Stability Of Neural Networks With Discontinuous Activation Functions And Time-Varying Delays

Stability Analysis for Stochastic Markovian Jump Reaction-Diffusion Neural Networks with Partially Known Transition Probabilities and Mixed Time Delays