Subspace Clustering Based on Latent Low-Rank Representation with Transformed Schatten-1 Penalty Function

Dong Hu,Qin Qu,Zhuo Liu,Wu Chen,Zhi Wang
DOI: https://doi.org/10.1016/j.knosys.2024.112538
2024-01-01
Abstract:Latent low-rank representation (LLRR) is a critical method to uncover the low-dimensional subspace structure embedded in high-dimensional data, especially when the data sampling is insufficient and/or extremely corrupted. However, LLRR uses the nuclear norm as a convex relaxation of the rank function, and thus the rank may not be well approximated in practice since the nuclear norm treats all singular values equally. To overcome this deficiency, in this paper, we propose a new model, TS1-LLRR, which extends LLRR along with its corresponding subspace clustering algorithm. We first adopt the non-convex transformed Schatten-1 (TS1) function, a better approximation to the rank of the matrix than the nuclear norm, to model the coefficient matrix. The proposed model works well in learning intrinsic rank information and thus has a stronger ability to capture the subspace structure. Furthermore, to solve the proposed non-convex model, we design an efficient iterative algorithm by using the alternating direction method of multipliers (ADMM) framework. This algorithm performs well in both accuracy and convergence speed, and the resulting subproblems have closed-form solutions. Last, we construct the affinity matrix for spectral clustering by further exploiting the angular information of the principal directions of the low-rank representation, which enhances the capability of investigating the inherent correlation between data points. Extensive experimental results on image clustering and motion segmentation show that our proposed subspace clustering method outperforms the compared methods.
What problem does this paper attempt to address?