Abstract:With the growing interest in convex and nonconvex low-rank matrix learning problems, the widely used singular value thresholding (SVT) operators associated with rank relaxation functions often face higher computational complexity, particularly for large-scale data matrices. To improve the efficacy of low-rank subspace clustering and overcome the issue of high computational complexity, this work proposes an efficient and effective method that avoids the need for singular value decomposition (SVD) computations in the iteration scheme. This can be achieved through the use of a computationally efficient and compact formulation, as well as automatic removal of the optimal mean, which reduces time consumption and enhances evaluation performance. A unified clustering framework based on Schatten- $p$ norm regularized by $\ell _{2,q}$ -norm can be formulated using this processing way, where inner element suppression can be achieved by choosing appropriate $p$ , $q \in (0,1)$ . Additionally, calculating the optimal mean enhances the robustness of the proposed method in the presence of outliers. Unlike the general iteration scheme of the alternating direction method of multiplier (ADMM) algorithms that introduce auxiliary splitting variables, the proposed alternating re-weighted least square (ARwLS) algorithm uses matrix inverse and multiplication computations to obtain analytic solutions, resulting in faster processing speeds for each sub-problem. To further investigate, we provide the computational complexity of each iteration and the theoretical analysis of the convergence property, where the derived solution is a stationary point. Experimental results on synthetic data and several benchmark datasets demonstrate the promising efficiency and efficacy of the proposed clustering method compared to classical and competing algorithms.

SVD‐Based Low‐Complexity Methods for Computing the Intersection of K ≥2 Subspaces

Closed-form algorithms for computing the intersection of two subspaces

Subspace Clustering by Directly Solving Discriminative K-means

The alternating simultaneous Halpern-Lions-Wittmann-Bauschke algorithm for finding the best approximation pair for two disjoint intersections of convex sets

Subspace Methods for Nonlinear Optimization

Limited Memory Block Krylov Subspace Optimization for Computing Dominant Singular Value Decompositions.

Robust Multi-subspace Analysis Using Novel Column L0-norm Constrained Matrix Factorization

Sketched and Truncated Polynomial Krylov Subspace Methods: Matrix Sylvester Equations

Almost Intersecting Families for Vector Spaces

The splitting algorithms by Ryu, by Malitsky-Tam, and by Campoy applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

How to project onto the intersection of a closed affine subspace and a hyperplane

Efficient Approaches for Summarizing Subspace Clusters into K Representatives

Anzahl theorems for disjoint subspaces generating a non-degenerate subspace II: quadratic forms

The splitting algorithms by Ryu and by Malitsky-Tam applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

The Second-Order Biorthogonalization Procedure and Its Application to Quadratic Eigenvalue Problems

A Projection Method Based on Extended Krylov Subspaces for Solving Sylvester Equations

Greedy double subspaces coordinate descent method via orthogonalization

Beyond Union of Subspaces: Subspace Pursuit on Grassmann Manifold for Data Representation

Efficient and Effective Nonconvex Low-Rank Subspace Clustering Via SVT-Free Operators

Second-order Krylov Subspace and Arnoldi Procedure

Iterative Methods by Space Decomposition and Subspace Correction