Abstract:For dimension reduction on multiview data, most of the previous studies implicitly take an assumption that all samples are completed in all views. Nevertheless, this assumption could often be violated in real applications due to the presence of noise, limited access to data, equipment malfunction, and so on. Most of the previous methods will cease to work when missing values in one or multiple views occur, thus an incomplete-data oriented dimension reduction becomes an important issue. To this end, we mathematically formulate the above-mentioned issue as sparse low-rank representation through multiview subspace (SRRS) learning to impute missing values, by jointly measuring intraview relations (via sparse low-rank representation) and interview relations (through common subspace representation). Moreover, by exploiting various subspace priors in the proposed SRRS formulation, we develop three novel dimension reduction methods for incomplete multiview data: 1) multiview subspace learning via graph embedding; 2) multiview subspace learning via structured sparsity; and 3) sparse multiview feature selection via rank minimization. For each of them, the objective function and the algorithm to solve the resulting optimization problem are elaborated, respectively. We perform extensive experiments to investigate their performance on three types of tasks including data recovery, clustering, and classification. Both two toy examples (i.e., Swiss roll and S-curve) and four real-orld data sets (i.e., face images, multisource news, multicamera activity, and multimodality neuroimaging data) are systematically tested. As demonstrated, our methods achieve the performance superior to that of the state-of-the-art comparable methods. Also, the results clearly show the advantage of integrating the sparsity and low-rankness over using each of them separately.

Dimension Reduction for Data with Heterogeneous Missingness

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

A probability based approach for processing dimension missing data

Incomplete-Data Oriented Multiview Dimension Reduction Via Sparse Low-Rank Representation

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Real-valued Multivariate Dimension Reduction: A Survey

An Imputation-Consistency Algorithm for High-Dimensional Missing Data Problems and Beyond

Distributed Sufficient Dimension Reduction for Heterogeneous Massive Data

A Dimensionality Reduction and Reconstruction Method for Data with Multiple Connected Components

Learning Heterogeneity in Causal Inference Using Sufficient Dimension Reduction

Dimension Reduction by Minimum Error Minimax Probability Machine

Exploring Dimension Learning Via a Penalized Probabilistic Principal Component Analysis

Inference for Large Dimensional Factor Models under General Missing Data Patterns

Handling Nonmonotone Missing Data with Available Complete-Case Missing Value Assumption

High Dimensional Covariance Matrix Estimation Using Multi-Factor Models from Incomplete Information

Matrix Completion for Survey Data Prediction with Multivariate Missingness

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

Accuracy, robustness and scalability of dimensionality reduction methods for single-cell RNA-seq analysis

On efficient dimension reduction with respect to the interaction between two response variables

Online Missing Value Imputation for High-Dimensional Mixed-Type Data via Generalized Factor Models

Matrix regression heterogeneity analysis