Abstract:Data driven soft sensor design has recently gained immense popularity, due to advances in sensory devices, and a growing interest in data mining. While partial least squares (PLS) is traditionally used in the process literature for designing soft sensors, the statistical literature has focused on sparse learners, such as Lasso and relevance vector machine (RVM), to solve the high dimensional data problem. In the current study, predictive performances of three regression techniques, PLS, Lasso and RVM were assessed and compared under various offline and online soft sensing scenarios applied on datasets from five real industrial plants, and a simulated process. In offline learning, predictions of RVM and Lasso were found to be superior to those of PLS when a large number of time-lagged predictors were used. Online prediction results gave a slightly more complicated picture. It was found that the minimum prediction error achieved by PLS under moving window (MW), or just-in-time learning scheme was decreased up to ~5-10% using Lasso, or RVM. However, when a small MW size was used, or the optimum number of PLS components was as low as ~1, prediction performance of PLS surpassed RVM, which was found to yield occasional unstable predictions. PLS and Lasso models constructed via online parameter tuning generally did not yield better predictions compared to those constructed via offline tuning. We present evidence to suggest that retaining a large portion of the available process measurement data in the predictor matrix, instead of preselecting variables, would be more advantageous for sparse learners in increasing prediction accuracy. As a result, Lasso is recommended as a better substitute for PLS in soft sensors; while performance of RVM should be validated before online application.

Unbiased prediction errors for partial least squares regression models: Choosing a representative error estimator for process monitoring

A Selective Moving Window Partial Least Squares Method and Its Application in Process Modeling

Online dual updating with recursive PLS model and its application in predicting crystal size of purified terephthalic acid (PTA) process

A Two-Step PLS Inspired Method for Linear Prediction with Group Effect

Estimating the influence of experimental parameters on the prediction error of PLS calibration models based on Raman spectra

Partial least squares with outlier detection in spectral analysis: A tool to predict gasoline properties

Multirate Partial Least Squares for Process Monitoring

[Near-Infrared Spectral Quantitative Analysis by Combining Classification with Local PLS].

Soft-sensor modeling via neural network PLS approach

Application of Near Infrared Spectroscopy Combined with Competitive Adaptive Reweighted Sampling Partial Least Squares for On-Line Monitoring of the Concentration Process of Wangbi Tablets

Systematic prediction error correction: A novel strategy for maintaining the predictive abilities of multivariate calibration models

Semisupervised Learning for Probabilistic Partial Least Squares Regression Model and Soft Sensor Application

An Exploratory Analysis of Biased Learners in Soft-Sensing Frames

Model selection for partial least squares regression

Calibration modeling by partial least-squares and principal component regression and its optimization using an improved leverage correction for prediction testing

Enhancing the Reliability and Accuracy of Data-Driven Dynamic Soft Sensor Based on Selective Dynamic Partial Least Squares Models

Investigation of an On-Line Detection Method Combining Near Infrared Spectroscopy with Local Partial Least Squares Regression for the Elution Process of Sodium Aescinate

Feasibility Study Of Near Infrared Spectroscopy With Variable Selection For Non-Destructive Determination Of Quality Parameters In Shell-Intact Cottonseed

$(ε, δ)$-Differentially Private Partial Least Squares Regression

The Importance of Balanced Data Sets for Partial Least Squares Discriminant Analysis: Classification Problems Using Hyperspectral Imaging Data

Probabilistic Learning of Partial Least Squares Regression Model: Theory and Industrial Applications