Abstract:As a step toward understanding the complex information from data and relationships, structural and discriminative knowledge reveals insight that may prove useful in data interpretation and exploration. This paper reports the development of an automated and intelligent procedure for generating the hierarchy of minimax entropy models and principal component visualization spaces for improved data explanation. The proposed hierarchical minimax entropy modeling and probabilistic principal component projection are both statistically principled and visually effective at revealing all of the interesting aspects of the data set. The methods involve multiple use of standard finite normal mixture models and probabilistic principal component projections. The strategy is that the top-level model and projection should explain the entire data set, best revealing the presence of clusters and relationships, while lower-level models and projections should display internal structure within individual clusters, such as the presence of subclusters and attribute trends, which might not be apparent in the higher-level models and projections. With many complementary mixture models and visualization projections, each level will be relatively simple while the complete hierarchy maintains overall flexibility yet still conveys considerable structural information. In particular, a model identification procedure is developed to select the optimal number and kernel shapes of local clusters from a class of data, resulting in a standard finite normal mixtures with minimum conditional bias and variance, and a probabilistic principal component neural network is advanced to generate optimal projections, leading to a hierarchical visualization algorithm allowing the complete data set to be analyzed at the top level, with best separated subclusters of data points analyzed at deeper levels. Hierarchical probabilistic principal component visualization involves (1) evaluation of posterior probabilities for mixture data set, (2) estimation of multiple principal component axes from probabilistic data set, and (3) generation of a complete hierarchy of visual projections. With a soft clustering of the data set ti via the EM algorithm, data points will effectively belong to more than one cluster at any given level with posterior probabilities denoted by z(ik). Thus, the effective input values are z(ik)t(i) for an independent visualization space k in the hierarchy. Further projections can again be performed using the effective input values z(ik)z(j\k)t(i) for the visualization subspace j. The complete visual explanation hierarchy is generated by performing principal projection (dimensionality reduction) and model identification (structure decomposition) in two iterative steps using information theoretic criteria, EM algorithm, and probabilistic principal component analysis.

Hierarchical Graphical Models for Multigroup Shape Analysis using Expectation Maximization with Sampling in Kendall's Shape Space

Shape Analysis Using Curvature-Based Descriptors And Profile Hidden Markov Models

Embedded Profile Hidden Markov Models for Shape Analysis

Graph-Based Shape Analysis for Heterogeneous Geometric Datasets: Similarity, Retrieval and Substructure Matching

Geodesic analysis in Kendall's shape space with epidemiological applications

A Profile Hidden Markov Model Framework for Modeling and Analysis of Shape

Manifold embedding for shape analysis

Learning Population-level Shape Statistics and Anatomy Segmentation From Images: A Joint Deep Learning Model

Discriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks

MCMC Shape Sampling for Image Segmentation with Nonparametric Shape Priors

Hierarchical Minimax Entropy Modeling and Probabilistic Principal Component Visualization for Data Exploration

Subject Specific Shape Modeling with Incremental Mixture Models

Non-rigid 3D Shape Retrieval Based on Multi-Scale Graphical Image and Joint Bayesian

Shape modeling and analysis with entropy-based particle systems

Data‐Driven Shape Analysis and Processing

Layered Shape Matching and Registration: Stochastic Sampling with Hierarchical Graph Representation

Shape Clustering: Common Structure Discovery.

Learning distributions of shape trajectories from longitudinal datasets: a hierarchical model on a manifold of diffeomorphisms

Smart Computing for Large Scale Visual Data Sensing and Processing

Discriminative Sketch-Based 3d Model Retrieval Via Robust Shape Matching

Hierarchical Shape Modeling for Automatic Face Localization