Abstract:Dimensionality reduction (DR) is a well-established approach for the visualization of high-dimensional data sets. While DR methods are often applied to typical DR benchmark data sets in the literature, they might suffer from high runtime complexity and memory requirements, making them unsuitable for large data visualization especially in environments outside of high-performance computing. To perform DR on large data sets, we propose the use of out-of-sample extensions. Such extensions allow inserting new data into existing projections, which we leverage to iteratively project data into a reference projection that consists only of a small manageable subset. This process makes it possible to perform DR out-of-core on large data, which would otherwise not be possible due to memory and runtime limitations. For metric multidimensional scaling (MDS), we contribute an implementation with out-of-sample projection capability since typical software libraries do not support it. We provide an evaluation of the projection quality of five common DR algorithms (MDS, PCA, t-SNE, UMAP, and autoencoders) using quality metrics from the literature and analyze the trade-off between the size of the reference set and projection quality. The runtime behavior of the algorithms is also quantified with respect to reference set size, out-of-sample batch size, and dimensionality of the data sets. Furthermore, we compare the out-of-sample approach to other recently introduced DR methods, such as PaCMAP and TriMAP, which claim to handle larger data sets than traditional approaches. To showcase the usefulness of DR on this large scale, we contribute a use case where we analyze ensembles of streamlines amounting to one billion projected instances.

Extending Dimensions in Radviz Based on Mean Shift

Extending Dimensions in Radviz for Visual Clustering Analysis

A Radviz-Based Visualization for Understanding Fuzzy Clustering Results

Fully Three-Dimensional Radial Visualization

Structure-preserving visualization for single-cell RNA-Seq profiles using deep manifold transformation with batch-correction

Radviz Deluxe: An Attribute-Aware Display For Multivariate Data

Interactive Dimension Reordering in RadViz with Correlation Matrix

Adaptive Contextualization Methods for Combating Selection Bias During High-Dimensional Visualization

Dimension Reconstruction for Visual Exploration of Subspace Clusters in High-Dimensional Data.

FuzzyRadar: Visualization for Understanding Fuzzy Clusters

AVIDA: Alternating method for Visualizing and Integrating Data

A three-dimensional display for big data sets

Out-of-Core Dimensionality Reduction for Large Data via Out-of-Sample Extensions

Multi-point dimensionality reduction to improve projection layout reliability

ADM: Adaptive Graph Diffusion for Meta-Dimension Reduction

Dynamic visualization of high-dimensional data

A spectral method for assessing and combining multiple data visualizations

Dimension Projection Matrix/Tree: Interactive Subspace Visual Exploration and Analysis of High Dimensional Data

An Incremental Dimensionality Reduction Method for Visualizing Streaming Multidimensional Data

A Visual Interaction Framework for Dimensionality Reduction Based Data Exploration

DimVis: Interpreting Visual Clusters in Dimensionality Reduction With Explainable Boosting Machine