Abstract:The task of dimensionality reduction and visualization of high-dimensional datasets remains a challenging problem since long. Modern high-throughput technologies produce large datasets having multiple views with relatively new data types. Visualization of these datasets require efficient algorithms that can uncover hidden patterns in the data without affecting the local and global structures, and bring out the inherent non-linearity within the data. To this end, however, very few such methodologies exist, which can realise this task. In this work, we have introduced a novel unsupervised deep neural network model, called NeuroDAVIS, for data visualization. NeuroDAVIS is capable of extracting important features from the data, without assuming any data distribution, visualize effectively in low dimension, and preserve both local and global structures simultaneously. It has been shown theoritically that neighbourhood relationship of the data in high dimension remains preserved in lower dimension. The performance of NeuroDAVIS has been evaluated on a wide variety of synthetic and real high-dimensional datasets including numeric, textual, image and biological data. NeuroDAVIS has been highly competitive against t-Distributed Stochastic Neighbor Embedding (t-SNE), Uniform Manifold Approximation and Projection (UMAP), Principal Component Analysis (PCA) and Random Projection (RP) with respect to visualization quality, preservation of data size, shape, and both local and global structure. It has outperformed Fast interpolation-based t-SNE (Fit-SNE), a variant of t-SNE, for most of the datasets. For the biological datasets, besides t-SNE, UMAP, Fit-SNE, PCA and RP, NeuroDAVIS has also performed well as compared to other state-of-the-art algorithms, like Potential of Heat-diffusion for Affinity-based Trajectory Embedding (PHATE) and the siamese neural network-based method, called IVIS. Downstream classification and clustering analyses have also revealed favourable results for NeuroDAVIS-generated embeddings.

Visualizing the decision-making process in deep neural decision forest

Facial age estimation by deep residual decision making

Learn Decision Trees with Deep Visual Primitives

Visualizing Deep Neural Network Decisions: Prediction Difference Analysis

Visualizing Surrogate Decision Trees of Convolutional Neural Networks

NeuralVis: Visualizing and Interpreting Deep Learning Models

SegNBDT: Visual Decision Rules for Segmentation

Visualizing the Random Forest by 3D Techniques

A Decision-Making Method for Air Combat Maneuver Based on Hybrid Deep Learning Network

Understanding The Prediction Process Of Deep Networks By Forests

DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumps

DeforestVis: Behaviour Analysis of Machine Learning Models with Surrogate Decision Stumps

Visualisation of Random Forest classification

NeuroDAVIS: A neural network model for data visualization

ViTree: Single-path Neural Tree for Step-wise Interpretable Fine-grained Visual Categorization

Feature Selection on Deep Learning Models: an Interactive Visualization Approach

Growing Deep Forests Efficiently with Soft Routing and Learned Connectivity

Learning Representations for Axis-Aligned Decision Forests through Input Perturbation

Interactive Decision Tree Creation and Enhancement with Complete Visualization for Explainable Modeling

Visualizing and Understanding Deep Neural Networks : A Case of Seismic Fault Detection Network