Abstract:Owing to sparseness, directly clustering high-dimensional data is still a challenge problem. Therefore, obtaining their low-dimensional compact representation by dimensional reduction is an effective method for clustering high-dimensional data. Most of existing dimensionality reduction methods, however, are developed originally for classification (such as Linear Discriminant Analysis) or recovering the geometric structure (known as manifold) of high-dimensional data (such as Locally Linear Embedding) rather than clustering purpose. Hence, a novel nonlinear discriminant clustering by dimensional reduction based on spectral regularization is proposed. The contributions of the proposed method are two folds: (1) it can obtain nonlinear low-dimensional representation that can recover the intrinsic manifold structure as well as enhance the cluster structure of the original high-dimensional data; (2) the clustering results can also be obtained in the dimensionality reduction procedure. Firstly, the desired low-dimensional coordinates are represented as linear combinations of predefined smooth vectors with respect to the data manifold, which are characterized by a weighted graph. Then, the optimal combination coefficients and the optimal cluster assignment matrix are computed by maximizing the ratio between the between-cluster scatter and the total scatter simultaneously as well as preserving the smoothness of the cluster assignment matrix with respect to the data manifold. Finally, the optimization problem is solved in an iterative procedure, which is proved to be convergent. Experiments on UCI data sets and real world data sets demonstrated the effectiveness of the proposed method for both clustering and visualization high-dimensional data set.

Linear Discriminative Star Coordinates for Exploring Class and Cluster Separation of High Dimensional Data.

Linear Discriminative Star Coordinates for Exploring Class and Cluster Separation of High Dimensional Data

Consistent Representation Learning for High Dimensional Data Analysis

Cluster aware Star Coordinates.

Local Feature Discriminant Projection

Subspace Clustering by Directly Solving Discriminative K-means

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Dimension Reconstruction for Visual Exploration of Subspace Clusters in High-Dimensional Data.

Robust Discriminant Subspace Clustering with Adaptive Local Structure Embedding.

Scatter Balance: an Angle-Based Supervised Dimensionality Reduction

A Dimension Reduction Algorithm Preserving Both Global and Local Clustering Structure

The Subspace Voyager: Exploring High-Dimensional Data along a Continuum of Salient 3D Subspaces

Discovering a sparse set of pairwise discriminating features in high dimensional data

Discriminant Hyper-Laplacian Projections and Its Scalable Extension for Dimensionality Reduction

Revisiting Dimensionality Reduction Techniques for Visual Cluster Analysis: An Empirical Study

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

Supervised Discriminative Sparse PCA with Adaptive Neighbors for Dimensionality Reduction

Coordinating Discernibility And Independence Scores Of Variables In A 2d Space For Efficient And Accurate Feature Selection

Nonlinear discriminant clustering based on spectral regularization

Discriminative Embedded Clustering: A Framework for Grouping High-Dimensional Data.

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection