Abstract:For dimension reduction on multiview data, most of the previous studies implicitly take an assumption that all samples are completed in all views. Nevertheless, this assumption could often be violated in real applications due to the presence of noise, limited access to data, equipment malfunction, and so on. Most of the previous methods will cease to work when missing values in one or multiple views occur, thus an incomplete-data oriented dimension reduction becomes an important issue. To this end, we mathematically formulate the above-mentioned issue as sparse low-rank representation through multiview subspace (SRRS) learning to impute missing values, by jointly measuring intraview relations (via sparse low-rank representation) and interview relations (through common subspace representation). Moreover, by exploiting various subspace priors in the proposed SRRS formulation, we develop three novel dimension reduction methods for incomplete multiview data: 1) multiview subspace learning via graph embedding; 2) multiview subspace learning via structured sparsity; and 3) sparse multiview feature selection via rank minimization. For each of them, the objective function and the algorithm to solve the resulting optimization problem are elaborated, respectively. We perform extensive experiments to investigate their performance on three types of tasks including data recovery, clustering, and classification. Both two toy examples (i.e., Swiss roll and S-curve) and four real-orld data sets (i.e., face images, multisource news, multicamera activity, and multimodality neuroimaging data) are systematically tested. As demonstrated, our methods achieve the performance superior to that of the state-of-the-art comparable methods. Also, the results clearly show the advantage of integrating the sparsity and low-rankness over using each of them separately.

Iteratively Reweighted Fitting for Reduced Multivariate Polynomial Model

Iteratively Reweighted Least Squares Method for Estimating Polyserial and Polychoric Correlation Coefficients

Low-rank kernel regression with preserved locality for multi-class analysis

Intelligent Fault Identification in Sample Imbalance Scenarios Using Robust Low-Rank Matrix Classifier with Fuzzy Weighting Factor

Robust reduced-rank regression

Simultaneous Dimension Reduction and Variable Selection for Multinomial Logistic Regression

Robust discriminative non-negative matrix factorization.

Leveraging Mixed and Incomplete Outcomes Via Reduced-Rank Modeling.

Reduced Rank Multivariate Kernel Ridge Regression

A New Method to Construct Reduced Vector Sets for Simplifying Support Vector Machines

LatLRR for subspace clustering via reweighted Frobenius norm minimization

Incomplete-Data Oriented Multiview Dimension Reduction Via Sparse Low-Rank Representation

Simplify decision function of reduced support vector machines

Robust multiclass least squares support vector classifier with optimal error distribution

Robust Low-Rank Matrix Factorization Via Block Iteratively Reweighted Least-Squares.

Smoothed Low Rank and Sparse Matrix Recovery by Iteratively Reweighted Least Squares Minimization

SWRM: Similarity Window Reweighting and Margin for Long-Tailed Recognition

Iterative re‐weighted multilinear partial least squares modelling for robust predictive modelling

A Robust Pruning Method For Reduced Weighted Least Squares Support Vector Machine

Simple and Fast Group Robustness by Automatic Feature Reweighting

Inter-class Sparsity Based Discriminative Least Square Regression.