Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

A Novel K -Means Framework Via Constrained Relaxation and Spectral Rotation

A Novel Method for Optimizing Spectral Rotation Embedding K-means with Coordinate Descent

Multiple Kernel K-Means Clustering with Simultaneous Spectral Rotation

An Effective and Efficient Algorithm for K-means Clustering with New Formulation

Scalable K-Means for Large-Scale Clustering.

Subspace Clustering by Directly Solving Discriminative K-means

Spectral Rotation versus K-Means in Spectral Clustering.

Relax and Merge: A Simple Yet Effective Framework for Solving Fair $k$-Means and $k$-sparse Wasserstein Barycenter Problems

K -Means: A Revisit

A new Kmeans clustering model and its generalization achieved by joint spectral embedding and rotation

Robust and Efficient Fuzzy C-Means Clustering Constrained on Flexible Sparsity

Coordinate Descent Method for K-Means.

The K-Sparse LSR for Subspace Clustering Via 0-1 Integer Programming

Spectral Relaxation for K-means Clustering

A Theoretic Framework of K-Means-Based Consensus Clustering.

A Constrained Partition Model and K-Means Algorithm

A cutting plane algorithm for globally solving low dimensional k-means clustering problems

Centerless Clustering: An Efficient Variant of K-means Based on K-NN Graph

Nonnegative Lagrangian Relaxation of K-Means and Spectral Clustering

Optimizing MSE for Clustering with Balanced Size Constraints

K*-Means: an Effective and Efficient K-Means Clustering Algorithm