Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

Discriminative Nonnegative Spectral Clustering with Out-of-Sample Extension

Nonnegative Spectral Clustering with Discriminative Regularization.

Unsupervised Feature Selection Using Nonnegative Spectral Analysis.

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Multiclass Spectral Clustering Based on Discriminant Analysis

Penalized Nonnegative Nonnegative Matrix Tri-Factorization For Co-Clustering

Spectral Embedded Clustering: A Framework for In-Sample and Out-of-Sample Spectral Clustering

Discretize Relaxed Solution of Spectral Clustering via a Non-Heuristic Algorithm

Robust discriminative non-negative matrix factorization.

Subspace Clustering by Directly Solving Discriminative K-means

A Convex Formulation for Spectral Shrunk Clustering

Spectral Clustering Based Null Space Linear Discriminant Analysis (Snlda)

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Unified Spectral Clustering with Optimal Graph

Joint learning of fuzzy embedded clustering and non-negative spectral clustering

Orthogonal and Nonnegative Graph Reconstruction for Large Scale Clustering

Outlier Cluster Formation in Spectral Clustering

Multi-way Constrained Spectral Clustering by Nonnegative Restriction

Spectral clustering with linear embedding: A discrete clustering method for large-scale data

Inverse-degree Sampling for Spectral Clustering

Document Clustering Based on Spectral Clustering and Non-negative Matrix Factorization