Abstract:Soft sensor, as a significant intelligent inspection technology, has been widely used in modern process industries to achieve effective monitoring and prediction of product quality. However, the redundancy of model inputs and structure in practical industrial process modeling usually results in increased modeling complexity and decreased model performance. In this study, an input variable selection and structure optimization algorithm for long short-term memory (LSTM)-based soft sensor with a dual nonnegative garrote (DNNG) approach was proposed. First, a well-trained initial LSTM model is constructed using the process dataset to capture the temporal dynamic behavior of the industrial process. Second, the DNNG algorithm is integrated into the LSTM to reduce the redundancy of input variables and hidden nodes. The strategy efficiently selects the most consequential input variables for the model, and simultaneously simplifies the LSTM structure by eliminating redundant recurrent hidden nodes to reduce model overfitting risk. Moreover, the hyperparameters of the model are determined by combining grid search with blocked cross-validation. Finally, the developed algorithm is compared to other state-of-the-art algorithms using a numerical case and employed to forecast the SO2 concentration in the net flue gas emissions of a coal-fired power plant desulphurization system. Comparative results show that the proposed algorithm effectively eliminates redundant variables and streamlines the model structure while presenting better prediction performance than other algorithms.

Development of input variable selection and structural optimization algorithm for recurrent neural network

A new variable selection algorithm for LSTM neural network

Input Variable Selection and Structure Optimization for LSTM-Based Soft Sensor With a Dual Nonnegative Garrote Approach

Soft Sensor Development With Nonlinear Variable Selection Using Nonnegative Garrote And Artificial Neural Network

Development of a variable selection method for soft sensor using artificial neural network and nonnegative garrote

A Novel Input Variable Selection and Structure Optimization Algorithm for Multilayer Perceptron-Based Soft Sensors

An Adaptive Variable Selection Algorithm for Gated Recurrent Unit Based on Sensitivity Analysis and Nonnegative Garrote

A Hybrid Variable Selection Algorithm for Multi-Layer Perceptron with Nonnegative Garrote and Extremal Optimization

Quasi-Recurrent Neural Networks with Embedded Variable Selection Module for Data Sequence Modeling in Dynamic Industrial Processes

Development of a Novel Variable Selection Algorithm for LSTM with LASSO

Design and Application of a Variable Selection Method for Multilayer Perceptron Neural Network With LASSO.

Performance of Soft Sensors Based on Stochastic Configuration Networks with Nonnegative Garrote

Recurrent Neural Network Based Modelling of Industrial Grinding Time Series Data

Design of an Adaptive Nonnegative Garrote Algorithm for Multi-Layer Perceptron- Based Soft Sensor

A two-stage evolutionary algorithm for variable selection in the development of RBF neural network models

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

Causal Variable Selection for Industrial Process Quality Prediction Via Attention-Based GRU Network

A Two-stage Sparse Optimization Algorithm for Gated Recurrent Units Estimators

Hybrid Mean Impact Value with Nonnegative Garrote for Input Variable Selection of Multi-Layer Perceptron

Zhang Neural Network for Linear Time-Varying Equation Solving and Its Robotic Application

Back-propagating Errors Through Artificial Neural Networks for Variable Selection