Abstract:Dimensionality reduction is a popular approach to tackle high-dimensional data with low-dimensional nature. Subspace Restricted Isometry Property, a newly-proposed concept, has proved to be a useful tool in analyzing the effect of dimensionality reduction algorithms on subspaces. In this paper, we provide a characterization of subspace Restricted Isometry Property, asserting that matrices which act as a near-isometry on low-dimensional subspaces possess subspace Restricted Isometry Property. This points out a unified approach to discuss subspace Restricted Isometry Property. Its power is further demonstrated by the possibility to prove with this result the subspace RIP for a large variety of random matrices encountered in theory and practice, including subgaussian matrices, partial Fourier matrices, partial Hadamard matrices, partial circulant/Toeplitz matrices, matrices with independent strongly regular rows (for instance, matrices with independent entries having uniformly bounded 4+ε moments), and log-concave ensembles. Thus our result could extend the applicability of random projections in subspace-based machine learning algorithms including subspace clustering and allow for the application of some useful random matrices which are easier to implement on hardware or are more efficient to compute.

Notes on the Proof of Direct Sum for Linear Subspace

Near-linear algebra

Direct sum graph of the subspaces of a finite dimensional vector space over finite fields

Completeness of Sums of Subspace of Bounded Functions and Applications

Subdirect sums of strong matrices

The splitting algorithms by Ryu and by Malitsky-Tam applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

Note on Minkowski Summation and Unimodularity in Discrete Convex Analysis

The splitting algorithms by Ryu, by Malitsky-Tam, and by Campoy applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

Decomposition in direct sum of seminormed vector spaces and Mazur–Ulam theorem

The Many Faces of the Subspace Theorem (after Adamczewski, Bugeaud, Corvaja, Zannier...)

A note on the linear systems on the projective bundles over Abelian varieties

Surface Proofs for Nonsymmetric Linear Logic (Extended Abstract)

A New Proof of The Strong Subadditivity Theorem

Subdirect Sums of H-matrices

On the existence of vectors dual to a set of linear functionals

Group invertibility of the sum in rings and its applications

Sums of linear transformations

Anzahl theorems for disjoint subspaces generating a non-degenerate subspace II: quadratic forms

Unraveling the Veil of Subspace RIP Through Near-Isometry on Subspaces

An Elementary Problem and Techniques in Linear Algebra

A Monotone+Skew Splitting Model for Composite Monotone Inclusions in Duality