Abstract:For dimension reduction on multiview data, most of the previous studies implicitly take an assumption that all samples are completed in all views. Nevertheless, this assumption could often be violated in real applications due to the presence of noise, limited access to data, equipment malfunction, and so on. Most of the previous methods will cease to work when missing values in one or multiple views occur, thus an incomplete-data oriented dimension reduction becomes an important issue. To this end, we mathematically formulate the above-mentioned issue as sparse low-rank representation through multiview subspace (SRRS) learning to impute missing values, by jointly measuring intraview relations (via sparse low-rank representation) and interview relations (through common subspace representation). Moreover, by exploiting various subspace priors in the proposed SRRS formulation, we develop three novel dimension reduction methods for incomplete multiview data: 1) multiview subspace learning via graph embedding; 2) multiview subspace learning via structured sparsity; and 3) sparse multiview feature selection via rank minimization. For each of them, the objective function and the algorithm to solve the resulting optimization problem are elaborated, respectively. We perform extensive experiments to investigate their performance on three types of tasks including data recovery, clustering, and classification. Both two toy examples (i.e., Swiss roll and S-curve) and four real-orld data sets (i.e., face images, multisource news, multicamera activity, and multimodality neuroimaging data) are systematically tested. As demonstrated, our methods achieve the performance superior to that of the state-of-the-art comparable methods. Also, the results clearly show the advantage of integrating the sparsity and low-rankness over using each of them separately.

FAST AND EFFICIENT DIMENSIONALITY REDUCTION USING STRUCTURALLY RANDOMMATRICES

Improved Measurement Matrix Construction with Pseudo-Random Sequence in Compressed Sensing

Randomized Dimension Reduction with Statistical Guarantees

Stable Manifold Embeddings with Structured Random Matrices

Restricted Structural Random Matrix for Compressive Sensing

Tensor Random Projection for Low Memory Dimension Reduction

A Low-Complexity Reconstruction Algorithm for Compressed Sensing Using Reed-Muller Sequences

Robust Structured Nonnegative Matrix Factorization for Image Representation.

Restricted Isometry Property of Subspace Projection Matrix Under Random Compression

Rigorous Restricted Isometry Property of Low-Dimensional Subspaces.

Singular Value Decomposition Projection for solving the small sample size problem in face recognition

Robust sparse low-rank embedding for image dimension reduction

Double shrinking sparse dimension reduction

Fast and Low-Memory Compressive Sensing Algorithms for Low Tucker-Rank Tensor Approximation from Streamed Measurements

Multi-point dimensionality reduction to improve projection layout reliability

Out-of-Core Dimensionality Reduction for Large Data via Out-of-Sample Extensions

Incomplete-Data Oriented Multiview Dimension Reduction Via Sparse Low-Rank Representation

Enhanced Expressive Power and Fast Training of Neural Networks by Random Projections

Restricted Isometry Property of Gaussian Random Projection for Finite Set of Subspaces.

Dimension Reduction for Fréchet Regression

On Probabilistic Embeddings in Optimal Dimension Reduction