Abstract:Partial least squares (PLS) regression has achieved desirable performance for modeling the relationship between a set of dependent (response) variables with another set of independent (predictor) variables, especially when the sample size is small relative to the dimension of these variables. In each iteration, PLS finds two latent variables from a set of dependent and independent variables via maximizing the product of three factors: variances of the two latent variables as well as the square of the correlation between these two latent variables. In this paper, we derived the mathematical formulation of the relationship between mean square error (MSE) and these three factors. We find that MSE is not monotonous with the product of the three factors. However, the corresponding optimization problem is difficult to solve if we extract the optimal latent variables directly based on this relationship. To address these problems, a novel multilinear regression model-variance constrained partial least squares (VCPLS) is proposed. In the proposed VCPLS, we find the latent variables via maximizing the product of the variance of latent variable from dependent variables and the square of the correlation between the two latent variables, while constraining the variance of the latent variable from independent variables must be larger than a predetermined threshold. The corresponding optimization problem can be solved computational efficiently, and the latent variables extracted by VCPLS are near-optimal. Compared with classical PLS and it is variants, VCPLS can achieve lower prediction error in the sense of MSE. The experiments are conducted on three near-infrared spectroscopy (NIR) data sets. To demonstrate the applicability of our proposed VCPLS, we also conducted experiments on another data set, which has different characteristics from NIR data. Experimental results verified the superiority of our proposed VCPLS.

Regularized Partial Least Squares with an Application to NMR Spectroscopy

Multi-way Partial Least Squares Modeling for Three-Dimensional Fluorescence Spectrometry

Application Of Partial Least Squares Support Vector Machines (Pls-Svm) In Spectroscopy Quantitative Analysis

A Unified Parallel Algorithm for Regularized Group PLS Scalable to Big Data

Penalized Partial Least Squares Based on B-Splines Transformations

Multilinear and Nonlinear Generalizations of Partial Least Squares: an Overview of Recent Advances

[HDDA] sparse subspace constrained partial least squares

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

Deep Learning Partial Least Squares

Variance constrained partial least squares

Using the Krylov subspace formulation to improve regularisation and interpretation in partial least squares regression

SIMPLS: An alternative approach to partial least squares regression

Dual-sPLS: A family of Dual Sparse Partial Least Squares regressions for feature selection and prediction with tunable sparsity; evaluation on simulated and near-infrared (NIR) data

Mixed-norm Partial Least Squares

A non-linear partial least squares based on monotonic inner relation

Jointly Sparse Global SIMPLS Regression

Analysing Spectroscopy Data Using Two-Step Group Penalized Partial Least Squares Regression

Laplacian Regularized Least Squares Regression and Its Dynamic Parameter Optimization for Near Infrared Spectroscopy Modeling

A nonlinear robust partial least squares method with application

Nonlinear Partial Least Squares Regressions for Spectral Quantitative Analysis

libPLS: An integrated library for partial least squares regression and linear discriminant analysis