Abstract:Conventional regression methods, such as multivariate linear regression (MLR) and its extension principal component regression (PCR), deal well with the situations that the data are of the form of low-dimensional vector. When the dimension grows higher, it leads to the under sample problem (USP): the dimensionality of the feature space is much higher than the number of training samples. However, little attention has been paid to such a problem. This paper first adopts an in-depth investigation to the USP in PCR, which answers three questions: 1) Why is USP produced? 2) What is the condition for USP, and 3) How is the influence of USP on regression. With the help of the above analysis, the principal components selection problem of PCR is presented. Subsequently, to address the problem of PCR, a multivariate multilinear regression (MMR) model is proposed which gives a substitutive solution to MLR, under the condition of multilinear objects. The basic idea of MMR is to transfer the multilinear structure of objects into the regression coefficients as a constraint. As a result, the regression problem is reduced to find two low-dimensional coefficients so that the principal components selection problem is avoided. Moreover, the sample size needed for solving MMR is greatly reduced so that USP is alleviated. As there is no closed-form solution for MMR, an alternative projection procedure is designed to obtain the regression matrices. For the sake of completeness, the analysis of computational cost and the proof of convergence are studied subsequently. Furthermore, MMR is applied to model the fitting procedure in the active appearance model (AAM). Experiments are conducted on both the carefully designed synthesizing data set and AAM fitting databases verified the theoretical analysis.

A New Computing Multivariate Spectral Analysis Method Based on Wavelet Transform

The Principal Component Regression Based On Wavelet For Multivariate Spectral Analysis

A Computational Spectral Analysis Method for Multi-Component Drugs Based on Wavelet Transform

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

A Multivariable Statistical Process Monitoring Method Based On Multiscale Analysis And Principal Curves

Support vector machine classification and regression based hybrid modeling method and its application in Raman spectral analysis

Robust Local Pcr and Its Application in Nir Spectral Quantitative Analysis

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

Improved Weighted Least Squares Support Vector Machines Algorithm And Its Applications In Spectroscopic Quantitative Analysis

Monitoring Method Based on Multivariate Statistical Signal Processing for Batch Process

Broadening the Scope of Food Quality Control: a Calibration Transfer Strategy for Minimizing External Influences on Spectral Analysis

Waveform Restoral of Multiple Mixed Acoustical Source Signals Based on Independent Component Analysis and Wavelet Packet Decomposition

Raman spectral quantitative analysis based on peaks-decomposition

Two-Level Independent Component Regression Model for Multivariate Spectroscopic Calibration

Combination Method of Principal Component and Wavelet Analysis for Multivariate Process Monitoring and Fault Diagnosis

Simultaneous wavelength selection and outlier detection in multivariate regression of near-infrared spectra

Wavelet Analysis Techniques Applied to Removing Varying Spectroscopic Background in Calibration Model for Pear Sugar Content

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

Wavelet Transfer Based Smoothing Principal Component Analysis

Multivariate Multilinear Regression

Spectra Data Analysis and Calibration Modeling Method Using Spectra Subspace Separation and Multiblock Independent Component Regression Strategy