Abstract:Traditional visualization techniques for multidimensional data sets, such as parallel coordinates, star glyphs, and scatterplot matrices, do not scale well to high dimensional data sets. A common approach to solve this problem is dimensionality reduction. Existing dimensionality reduction techniques, such as Principal Component Analysis, Multidimensional Scaling, and Self Organizing Maps, have serious drawbacks in that the generated low dimensional subspace has no intuitive meaning to users. In addition, little user interaction is allowed in those highly automatic processes. In this thesis, we propose a new methodology to dimensionality reduction that combines automation and user interaction for the generation of meaningful subspaces, called the visual hierarchical dimension reduction (VHDR) framework. Firstly, VHDR groups all dimensions of a data set into a dimension hierarchy. This hierarchy is then visualized using a radial space-filling hierarchy visualization tool called Sunburst. Thus users are allowed to interactively explore and modify the dimension hierarchy, and select clusters at different levels of detail for the data display. VHDR then assigns a representative dimension to each dimension cluster selected by the users. Finally, VHDR maps the high-dimensional data set into the subspace composed of these representative dimensions and displays the projected subspace. To accomplish the latter, we have designed several extensions to existing popular multidimensional display techniques, such as parallel coordinates, star glyphs, and scatterplot matrices. These displays have been enhanced to express semantics of the selected subspace, such as the context of the dimensions and dissimilarity among the individual dimensions in a cluster. We have implemented all these features and incorporated them into the XmdvTool software package, which will be released as XmdvTool Version 6.0. Lastly, we developed two case studies to show how we apply VHDR to visualize and interactively explore a high dimensional data set.

HUMAP: Hierarchical Uniform Manifold Approximation and Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

Deep Manifold Transformation for Dimension Reduction

UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction

Hybrid Hierarchical Clustering - Piecewise Aggregate Approximation, with Applications

Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

Cluster Exploration using Informative Manifold Projections

Visual Hierarchical Dimension Reduction for Exploration of High Dimensional Datasets

DMT-HI: MOE-based Hyperbolic Interpretable Deep Manifold Transformation for Unspervised Dimensionality Reduction

Visual Hierarchical Dimension Reduction

CBMAP: Clustering-based manifold approximation and projection for dimensionality reduction

Spectral-Locational-Spatial Manifold Learning for Hyperspectral Images Dimensionality Reduction

Towards a Comprehensive Evaluation of Dimension Reduction Methods for Transcriptomic Data Visualization

Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey

Explaining dimensionality reduction results using Shapley values

Dimensionality Reduction of Hyperspectral Image Based on Local Constrained Manifold Structure Collaborative Preserving Embedding

Interpreting High-Dimensional Projections with Capacity.

Understanding High Dimensional Spaces through Visual Means Employing Multidimensional Projections

A General Framework for Manifold Reconstruction from Dimensionality Reduction.

Out-of-Core Dimensionality Reduction for Large Data via Out-of-Sample Extensions