Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

Clustering Large Datasets by Merging K-Means Solutions

A Novel Kernel Possibitistic Fuzzy C-Means Clustering Algorithm For Large Scale Data Sets

Combining multiple clusterings via k-modes algorithm

Merging $K$-means with hierarchical clustering for identifying general-shaped groups

Multi-Prototypes Convex Merging Based K-Means Clustering Algorithm

Scalable K-Means for Large-Scale Clustering.

Distributed Kernel K-Means for Large Scale Clustering

Subspace Clustering by Directly Solving Discriminative K-means

K-Means Clustering with Bagging and MapReduce

Bilateral k-Means Algorithm for Fast Co-Clustering.

K*-Means: An Efficient Clustering Algorithm with Adaptive Decision Boundaries

Clustering Stable Instances of Euclidean k-means

Scalable Multiple Kernel K -Means Clustering.

Compressed K-Means for Large-Scale Clustering.

Scalable Clustering: Large Scale Unsupervised Learning of Gaussian Mixture Models with Outliers

Hybridization of Expectation-Maximization and K-Means Algorithms for Better Clustering Performance

K-Means Clustering With Incomplete Data

Robust Deep K-Means: an Effective and Simple Method for Data Clustering.

Hybrid k-Clustering: Blending k-Median and k-Center

Large-scale K-Means Clustering Via Variance Reduction.

The Study Of Parallel K-Means Algorithm