Abstract:Subspace segmentation or subspace learning is a challenging and complicated task in machine learning. This paper builds a primary frame and solid theoretical bases for the minimal subspace segmentation (MSS) of finite samples. Existence and conditional uniqueness of MSS are discussed with conditions generally satisfied in applications. Utilizing weak prior information of MSS, the minimality inspection of segments is further simplified to the prior detection of partitions. The MSS problem is then modeled as a computable optimization problem via self-expressiveness of samples. A closed form of representation matrices is first given for the self-expressiveness, and the connection of diagonal blocks is then addressed. The MSS model uses a rank restriction on the sum of segment ranks. Theoretically, it can retrieve the minimal sample subspaces that could be heavily intersected. The optimization problem is solved via a basic manifold conjugate gradient algorithm, alternative optimization and hybrid optimization, taking into account of solving both the primal MSS problem and its pseudo-dual problem. The MSS model is further modified for handling noisy data, and solved by an ADMM algorithm. The reported experiments show the strong ability of the MSS method on retrieving minimal sample subspaces that are heavily intersected.

On Minimal Splitting Subspaces and Markovian Representations

On the structure of minimal splitting subspaces in stochastic realization theory

On a condition for minimality of Markovian splitting subspaces

A hardy space approach to the stochastic realization problem

ONTHE STOCHASTIC REALIZATION PROBLEM

Zeros of Spectral Factors, the Geometry of Splitting Subspaces, and the Algebraic Riccati Inequality

Markovian representation of discrete-time stationary stochastic vector processes

On the Stochastic Realization Problem

State Space Models for Gaussian Stochastic Processes.

Realization Theory for Multivariate Stationary Gaussian Processes

Invariant Subspaces and Representations of Certain Von Neumann Algebras

On “subspace Methods” Identification and Stochastic Model Reduction

On stability and index of minimal submanifolds

Extending the noise of splitting to its completion and stability of Brownian maxima

On minimal LPV state-space representations in innovation form: an algebraic characterization

TOWARD A SOLUTION OF THE MINIMAL PARTIAL STOCHASTIC-REALIZATION PROBLEM

A small remark on Bernstein's theorem

On the Partial Stochastic Realization Problem

Substituting Independent Processes

Minimal Sample Subspace Learning: Theory and Algorithms

Minimal self-adjoint compact operators, moment of a subspace and joint numerical range