Abstract:Highlights • Transfer learning methodology to overcome data scarcity in process modeling. • Weight-sharing recurrent neural networks (RNN) exploit process knowledge to use data for transfer learning. • Masking of variables allows for more efficient model training than conventional RNN. • Suitable for processes that can be decomposed into subsystems. Artificial neural networks (ANNs), one of the deep learning techniques that has sparked a lot of attention recently for its exceptional modelling capabilities of nonlinear systems, are an essential candidate for model-based control systems. In particular, recurrent neural networks (RNN) have shown remarkable capacity to forecast the dynamic behaviour of nonlinear processes using time-series data. In order to regulate the rate at which chemical species are produced in intricate processes, RNNs have successfully served as the predictive model in model-based controllers. However, the necessity for massive amounts of data to capture complex processes is a drawback of typical RNN models. With the goal of efficient utilisation of the available data, a different, transfer learning-based training approach for RNNs is presented in this work. The transfer learning strategy is taken into consideration to overcome the challenges stemming from lack of data for the construction of RNN models. In particular, weight-sharing RNNs are developed using a priori physical knowledge. Next, a comprehensive analysis of a complex chemical process on a large scale is conducted to showcase the benefits of the suggested approach across various data sizes and its effectiveness when combined with MPC in contrast to conventional RNNs.

A Novel Recurrent Neural Network for Dynamic Process Modeling with Inertia and Delay.

Recurrent Neural Network Integrated with Process-Priori-knowledge and Its Application

Recurrent Neural Networks for Recursive Identification of Nonlinear Dynamic Process

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

Deep Neural Network-Embedded Stochastic Nonlinear State-Space Models and Their Applications to Process Monitoring

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

A Novel Time-Delay Recurrent Neural Network and Application for Identifying and Controlling Nonlinear Systems

Model predictive control of nonlinear processes using transfer learning-based recurrent neural networks

Deep Recurrent Stochastic Configuration Networks for Modelling Nonlinear Dynamic Systems

Recurrent neural networks for dynamical systems: Applications to ordinary differential equations, collective motion, and hydrological modeling

Improved Adaptive Recurrent Neural Network for Data-Driven Modeling of High Speed Trains

Modeling Nonlinear Dynamic Chemical Process Base on Artificial Neural Networks

Revising the Structure of Recurrent Neural Networks to Eliminate Numerical Derivatives in Forming Physics Informed Loss Terms with Respect to Time

A New Recurrent Neural Network with Noise-Tolerance and Finite-Time Convergence for Dynamic Quadratic Minimization.

Identification And Control Of Nonlinear Systems By A Time-Delay Recurrent Neural Network

Dynamic Prediction Model Based on Process Neural Networks and Its Application

Physics-informed recurrent neural network modeling for predictive control of nonlinear processes

Recurrent-Neural-Network-Based Multivariable Adaptive Control for a Class of Nonlinear Dynamic Systems With Time-Varying Delay

Deep Process Neural Network for Temporal Deep Learning

Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networks