Abstract:Partial least squares (PLS) regression has achieved desirable performance for modeling the relationship between a set of dependent (response) variables with another set of independent (predictor) variables, especially when the sample size is small relative to the dimension of these variables. In each iteration, PLS finds two latent variables from a set of dependent and independent variables via maximizing the product of three factors: variances of the two latent variables as well as the square of the correlation between these two latent variables. In this paper, we derived the mathematical formulation of the relationship between mean square error (MSE) and these three factors. We find that MSE is not monotonous with the product of the three factors. However, the corresponding optimization problem is difficult to solve if we extract the optimal latent variables directly based on this relationship. To address these problems, a novel multilinear regression model-variance constrained partial least squares (VCPLS) is proposed. In the proposed VCPLS, we find the latent variables via maximizing the product of the variance of latent variable from dependent variables and the square of the correlation between the two latent variables, while constraining the variance of the latent variable from independent variables must be larger than a predetermined threshold. The corresponding optimization problem can be solved computational efficiently, and the latent variables extracted by VCPLS are near-optimal. Compared with classical PLS and it is variants, VCPLS can achieve lower prediction error in the sense of MSE. The experiments are conducted on three near-infrared spectroscopy (NIR) data sets. To demonstrate the applicability of our proposed VCPLS, we also conducted experiments on another data set, which has different characteristics from NIR data. Experimental results verified the superiority of our proposed VCPLS.

A novel multivariate regression approach based on kernel partial least squares with orthogonal signal correction

Nonlinear Multivariate Quality Estimation and Prediction Based on Kernel Partial Least Squares

Investigation Of Nonlinear Orthogonal Signal Correction Algorithm And Its Effects On Multivariate Calibration

Study on Kernel Partial Least Squares Based Key Indicator Prediction.

Kernel partial least squares regression for functional nonlinear models

Variance constrained partial least squares

Kernel partial robust M-regression as a flexible robust nonlinear modeling technique

Nonlinear Parameter Prediction of Fossil Power Plant Based on OSC-KPLS

Nonlinear Dynamic Process Monitoring Based on Kernel Partial Least Squares

Multilinear and Nonlinear Generalizations of Partial Least Squares: an Overview of Recent Advances

Approximate Kernel Partial Least Squares

Multikernel semiparametric linear programming support vector regression

Entropy-Clustering and K-means Based Kernel Partial Least Squares Soft-Sensing Method

A nonlinear robust partial least squares method with application

Kernel partial least squares based on least squares support vector machine prima l-dual optimization problem

Nonlinear Multivariate Quality Prediction Based on OSC-SVM-PLS

Kernel Stochastic Configuration Networks for Nonlinear Regression

Kernel PLS based prediction model construction and simulation on theoretical cases

On using prototype reduction schemes and classifier fusion strategies to optimize kernel-based nonlinear subspace methods

Dynamic Prediction of Multivariate Functional Data Based on Functional Kernel Partial Least Squares

Response Surface Modeling by Local Kernel Partial Least Squares.