Abstract:Applications in many domains such as text mining and natural language processing need to deal with high-dimensional data. High-dimensional data may present better clustering characteristics on a selected low-dimensional subspace. Subspace clustering is to project the data onto a low-dimensional subspace before clustering. Traditional subspace clustering methods employ eigenvalue decomposition to find the projection of the input data and perform K-means or kernel K-means to obtain the clustering matrix. This kind of methods is not only inefficient, but also adopts a two-step method to generate an approximate solution. Although Discriminative K-means (DisKmeans) integrates dimensionality reduction and clustering into a joint framework and solves the optimization problem by kernel K-means, such method needs to find the centroids in the kernel space and class labels iteratively and has a square time complexity. Accordingly, in this paper, we propose an algorithm, namely Fast DisKmeans (FDKM), to obtain the cluster indicator matrix in a direct way. Moreover, our proposed method has a linear time complexity, which is a significant reduction compared with the squared time complexity of DisKmeans. We also demonstrate that solving the object function of DisKmeans is equivalent to representing the cluster assignment matrix by a low-dimensional linear mapping of the data. Based on this observation, we propose the second algorithm, namely Iterative Fast DisKmeans (IFDKM), which also has a linear time complexity. A series of experiments were conducted on several datasets, and the experimental results showed the superior performance of FDKM and IFDKM.

Max-K-Min Distance Analysis for Dimension Reduction

Max-Min Distance Analysis by Using Sequential SDP Relaxation for Dimension Reduction

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Heteroscedastic Max–Min Distance Analysis for Dimensionality Reduction

Heteroscedastic Max-Min Distance Analysis.

Discriminative Dimension Reduction Via Maximin Separation Probability Analysis

Distance metric learning by minimal distance maximization

Dimension Reduction by Maximizing Pairwise Discriminations.

Dimension Reduction by Minimum Error Minimax Probability Machine

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Worst-Case Discriminative Feature Learning via Max-Min Ratio Analysis

Maximum Margin Multi-Dimensional Classification

Neighborhood MinMax Projections

Subspace Clustering by Directly Solving Discriminative K-means

Dimension Reduction With Prior Information for Knowledge Discovery

Two Dimensional Maximum Margin Criterion

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Median-Mean Line Based Discriminant Analysis

Complete discriminant analysis

Discriminant Maximum Margin Projections for Face Recognition.

Maximum Margin Embedding