Abstract:Partial least squares (PLS) regression has achieved desirable performance for modeling the relationship between a set of dependent (response) variables with another set of independent (predictor) variables, especially when the sample size is small relative to the dimension of these variables. In each iteration, PLS finds two latent variables from a set of dependent and independent variables via maximizing the product of three factors: variances of the two latent variables as well as the square of the correlation between these two latent variables. In this paper, we derived the mathematical formulation of the relationship between mean square error (MSE) and these three factors. We find that MSE is not monotonous with the product of the three factors. However, the corresponding optimization problem is difficult to solve if we extract the optimal latent variables directly based on this relationship. To address these problems, a novel multilinear regression model-variance constrained partial least squares (VCPLS) is proposed. In the proposed VCPLS, we find the latent variables via maximizing the product of the variance of latent variable from dependent variables and the square of the correlation between the two latent variables, while constraining the variance of the latent variable from independent variables must be larger than a predetermined threshold. The corresponding optimization problem can be solved computational efficiently, and the latent variables extracted by VCPLS are near-optimal. Compared with classical PLS and it is variants, VCPLS can achieve lower prediction error in the sense of MSE. The experiments are conducted on three near-infrared spectroscopy (NIR) data sets. To demonstrate the applicability of our proposed VCPLS, we also conducted experiments on another data set, which has different characteristics from NIR data. Experimental results verified the superiority of our proposed VCPLS.

Programming and Application of Incomplete Data Partial Least-Squares Method

Optimal Selection of Secondary Variables Based on GA-PLS Algorithm and Its Application to Soft Sensor Modeling

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

A test of significance for partial least squares regression

Locally Linear Approximation Approach for Incomplete Data.

A Variable Selection Method for Soft Sensor Development Through Mixed Integer Quadratic Programming

An Integrated Approach of Data Rectification Based-on Nonlinear Programming

Semisupervised Learning for Probabilistic Partial Least Squares Regression Model and Soft Sensor Application

Variance constrained partial least squares

Probabilistic Learning of Partial Least Squares Regression Model: Theory and Industrial Applications

Partial Least Squares Methods: Partial Least Squares Correlation and Partial Least Square Regression

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Total least squares adjustment in inequality constrained partial errors-in-variables models: optimality conditions and algorithms

Recursive Least-Squares Method with Membership Functions

Sequential Quadratic Programming Method for Nonlinear Least Squares Estimation and Its Application

Weighted least squares and quasi-weighted least squares combined method for data rectification

An adaptive strategy to improve the partial least squares model via minimum covariance determinant

Fitting and Prediction Study of Compressor Characteristics Using Least Squares Support Vector Machine Technology

Nonlinear Recursive Partial Least Squares and Its Applications

Model selection for partial least squares regression

Cross-validation of component models: A critical look at current methods