Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

Clustering Based on Supervised Learning of Exemplar Discriminative Information

A Multi-Task Learning Strategy for Unsupervised Clustering Via Explicitly Separating the Commonality

Subspace Clustering by Directly Solving Discriminative K-means

Supervised Convex Clustering

Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

Semi-Supervised Clustering Algorithm Based on Deep Feature Mapping

Unsupervised Learning Via An Iteratively Constructed Clustering Ensemble

Learning deep discriminative representations with pseudo supervision for image clustering

Learning with Clustering Structure

Unsupervised Dimension Reduction Using Supervised Orthogonal Discriminant Projection for Clustering.

Unsupervised discriminative feature learning via finding a clustering-friendly embedding space

Discriminative Similarity for Clustering and Semi-Supervised Learning

Discriminative Similarity for Data Clustering

Semi-Supervised Hybrid Clustering by Integrating Gaussian Mixture Model and Distance Metric Learning

Unsupervised Learning on 3D Point Clouds by Clustering and Contrasting

Discriminative Clustering Via Extreme Learning Machine.

DSKmeans: A new kmeans-type approach to discriminative subspace clustering

Unsupervised Deep Discriminant Analysis Based Clustering

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Clusterer ensemble

Stratification-based Semi-supervised Clustering Algorithm for Arbitrary Shaped Datasets