Abstract:For dimension reduction on multiview data, most of the previous studies implicitly take an assumption that all samples are completed in all views. Nevertheless, this assumption could often be violated in real applications due to the presence of noise, limited access to data, equipment malfunction, and so on. Most of the previous methods will cease to work when missing values in one or multiple views occur, thus an incomplete-data oriented dimension reduction becomes an important issue. To this end, we mathematically formulate the above-mentioned issue as sparse low-rank representation through multiview subspace (SRRS) learning to impute missing values, by jointly measuring intraview relations (via sparse low-rank representation) and interview relations (through common subspace representation). Moreover, by exploiting various subspace priors in the proposed SRRS formulation, we develop three novel dimension reduction methods for incomplete multiview data: 1) multiview subspace learning via graph embedding; 2) multiview subspace learning via structured sparsity; and 3) sparse multiview feature selection via rank minimization. For each of them, the objective function and the algorithm to solve the resulting optimization problem are elaborated, respectively. We perform extensive experiments to investigate their performance on three types of tasks including data recovery, clustering, and classification. Both two toy examples (i.e., Swiss roll and S-curve) and four real-orld data sets (i.e., face images, multisource news, multicamera activity, and multimodality neuroimaging data) are systematically tested. As demonstrated, our methods achieve the performance superior to that of the state-of-the-art comparable methods. Also, the results clearly show the advantage of integrating the sparsity and low-rankness over using each of them separately.

Subspace Discrimination for Multiway Data

A Report on Multilinear PCA Plus Multilinear LDA to Deal with Tensorial Data: Visual Classification As an Example

Subspace Data Visualization With Dissimilarity Based On Principal Angle

Scalable Nonparametric Multiway Data Analysis.

Multilinear Class-Specific Discriminant Analysis

Subspace Clustering by Directly Solving Discriminative K-means

The Subspace Voyager: Exploring High-Dimensional Data along a Continuum of Salient 3D Subspaces

Detecting and Visualizing Profile Correlation in Subspace

Tensor Subspace Analysis.

Subspace Learning Based on Tensor Analysis

Exsavi: Excavating both sample-wise and view-wise relationships to boost multi-view subspace clustering

Data integration via analysis of subspaces (DIVAS)

Discriminating sample groups with multi-way data

Orthogonal multi-view analysis by successive approximations via eigenvectors

Multiway sparse distance weighted discrimination

Incomplete-Data Oriented Multiview Dimension Reduction Via Sparse Low-Rank Representation

Understanding High Dimensional Spaces through Visual Means Employing Multidimensional Projections

A New Approach to Discover Interlacing Data Structures in High-Dimensional Space

Low-rank Multi-view Clustering in Third-Order Tensor Space

Spectral Flow on the Manifold of SPD Matrices for Multimodal Data Processing

Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors