Abstract:For dimension reduction on multiview data, most of the previous studies implicitly take an assumption that all samples are completed in all views. Nevertheless, this assumption could often be violated in real applications due to the presence of noise, limited access to data, equipment malfunction, and so on. Most of the previous methods will cease to work when missing values in one or multiple views occur, thus an incomplete-data oriented dimension reduction becomes an important issue. To this end, we mathematically formulate the above-mentioned issue as sparse low-rank representation through multiview subspace (SRRS) learning to impute missing values, by jointly measuring intraview relations (via sparse low-rank representation) and interview relations (through common subspace representation). Moreover, by exploiting various subspace priors in the proposed SRRS formulation, we develop three novel dimension reduction methods for incomplete multiview data: 1) multiview subspace learning via graph embedding; 2) multiview subspace learning via structured sparsity; and 3) sparse multiview feature selection via rank minimization. For each of them, the objective function and the algorithm to solve the resulting optimization problem are elaborated, respectively. We perform extensive experiments to investigate their performance on three types of tasks including data recovery, clustering, and classification. Both two toy examples (i.e., Swiss roll and S-curve) and four real-orld data sets (i.e., face images, multisource news, multicamera activity, and multimodality neuroimaging data) are systematically tested. As demonstrated, our methods achieve the performance superior to that of the state-of-the-art comparable methods. Also, the results clearly show the advantage of integrating the sparsity and low-rankness over using each of them separately.

Penalized Weighted Variance Estimate for Dimension Reduction

On Sliced Inverse Regression with High-Dimensional Covariates

Sliced Regression for Dimension Reduction

Slice Weighted Average Regression

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Penalized Time-Varying Model Averaging

A Slicing‐Free Perspective to Sufficient Dimension Reduction: Selective Review and Recent Developments

Dimension reduction in spatial regression with kernel SAVE method

EIGENVALUE DISTRIBUTIONS OF VARIANCE COMPONENTS ESTIMATORS IN HIGH-DIMENSIONAL RANDOM EFFECTS MODELS

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

The Alternating Direction Method of Multipliers for Sufficient Dimension Reduction

On expectile-assisted inverse regression estimation for sufficient dimension reduction

New forest-based approaches for sufficient dimension reduction

Projective Resampling Functional Sliced Inverse Regression

Sliced Coordinate Analysis for Effective Dimension Reduction and Nonlinear Extensions

Penalized weighted smoothed quantile regression for high‐dimensional longitudinal data

Slicing-free Inverse Regression in High-dimensional Sufficient Dimension Reduction

Improving disentanglement in variational auto-encoders via feature imbalance-informed dimension weighting

Penalized Sparse Covariance Regression with High Dimensional Covariates

Incomplete-Data Oriented Multiview Dimension Reduction Via Sparse Low-Rank Representation

A principal-weighted penalized regression model and its application in economic modeling