Abstract: High dimensional data analysis for exploration and discovery includes three fundamental tasks: dimensionality reduction, clustering, and visualization. When the three associated tasks are done separately, as is often the case thus far, inconsistencies can occur among the tasks in terms of data geometry and others. This can lead to confusing or misleading data interpretation. In this paper, we propose a novel neural network-based method, called Consistent Representation Learning (CRL), to accomplish the three associated tasks end-to-end and improve the consistencies. The CRL network consists of two nonlinear dimensionality reduction (NLDR) transformations: (1) one from the input data space to the latent feature space for clustering, and (2) the other from the clustering space to the final 2D or 3D space for visualization. Importantly, the two NLDR transformations are performed to best satisfy local geometry preserving (LGP) constraints across the spaces or network layers, to improve data consistencies along with the processing flow. Also, we propose a novel metric, clustering-visualization inconsistency (CVI), for evaluating the inconsistencies. Extensive comparative results show that the proposed CRL neural network method outperforms the popular t-SNE and UMAP-based and other contemporary clustering and visualization algorithms in terms of evaluation metrics and visualization.

Representative Null Space LDA for Discriminative Dimensionality Reduction

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Theoretical Analysis of Direct LDA in Small Sample Size Problem

Null Space-Based LDA with Weighted Dual Personal Subspaces for Face Recognition.

Spectral Clustering Based Null Space Linear Discriminant Analysis (Snlda)

3E-LDA

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

A New Reduced-Rank Linear Discriminant Analysis Method and Its Applications

Nonnegative Discriminative Manifold Learning for Hyperspectral Data Dimension Reduction.

A Novel Method for Constructing Low-Dimensional Linear Discriminative Subspace

Local Feature Discriminant Projection

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Adaptive Local Linear Discriminant Analysis

Laplacian Regularized Nonnegative Representation for Clustering and Dimensionality Reduction

Dimension reduction of multimodal data by auto-weighted local discriminant analysis

Deep Dimension Reduction for Supervised Representation Learning

Consistent Representation Learning for High Dimensional Data Analysis

Multimodal Linear Discriminant Analysis Via Structural Sparsity

Large-margin Weakly Supervised Dimensionality Reduction.

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

Neighborhood linear discriminant analysis