Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

$k$-means on Positive Definite Matrices, and an Application to Clustering in Radar Image Sequences

Radar Hrrp Target Recognition Based On The Improved Kernel Distance Fuzzy C-Means Clustering Method

Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices

Kernel Clustering on Symmetric Positive Definite Manifolds Via Double Approximated Low Rank Representation

EPTAS for $k$-means Clustering of Affine Subspaces

Random matrix theory improved Fréchet mean of symmetric positive definite matrices

Subspace Clustering by Directly Solving Discriminative K-means

Collaborative Representation for SPD Matrices with Application to Image-Set Classification

Neighborhood Preserved Sparse Representation for Robust Classification on Symmetric Positive Definite Matrices

Spatiotemporal k-means

Geometric statistics with subspace structure preservation for SPD matrices

Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach

Component SPD Matrices: A lower-dimensional discriminative data descriptor for image set classification

Differential geometry with extreme eigenvalues in the positive semidefinite cone

Improving K-Subspaces Via Coherence Pursuit

A Point-cloud Clustering & Tracking Algorithm for Radar Interferometry

Statistically Optimal K-means Clustering via Nonnegative Low-rank Semidefinite Programming

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications

Sliced-Wasserstein on Symmetric Positive Definite Matrices for M/EEG Signals

Log-Euclidean Kernels for Sparse Representation and Dictionary Learning

Grassmann Clustering.