Abstract:BACKGROUND While several algorithms for the comparison of univariate distributions arising from flow cytometric analyses have been developed and studied for many years, algorithms for comparing multivariate distributions remain elusive. Such algorithms could be useful for comparing differences between samples based on several independent measurements, rather than differences based on any single measurement. It is conceivable that distributions could be completely distinct in multivariate space, but unresolvable in any combination of univariate histograms. Multivariate comparisons could also be useful for providing feedback about instrument stability, when only subtle changes in measurements are occurring. METHODS We apply a variant of Probability Binning, described in the accompanying article, to multidimensional data. In this approach, hyper-rectangles of n dimensions (where n is the number of measurements being compared) comprise the bins used for the chi-squared statistic. These hyper-dimensional bins are constructed such that the control sample has the same number of events in each bin; the bins are then applied to the test samples for chi-squared calculations. RESULTS Using a Monte-Carlo simulation, we determined the distribution of chi-squared values obtained by comparing sets of events from the same distribution; this distribution of chi-squared values was identical as for the univariate algorithm. Hence, the same formulae can be used to construct a metric, analogous to a t-score, that estimates the probability with which distributions are distinct. As for univariate comparisons, this metric scales with the difference between two distributions, and can be used to rank samples according to similarity to a control. We apply the algorithm to multivariate immunophenotyping data, and demonstrate that it can be used to discriminate distinct samples and to rank samples according to a biologically-meaningful difference. CONCLUSION Probability binning, as shown here, provides a useful metric for determining the probability with which two or more multivariate distributions represent distinct sets of data. The metric can be used to identify the similarity or dissimilarity of samples. Finally, as demonstrated in the accompanying paper, the algorithm can be used to gate on events in one sample that are different from a control sample, even if those events cannot be distinguished on the basis of any combination of univariate or bivariate displays. Published 2001 Wiley-Liss, Inc.

Bayesian estimation of the Kullback-Leibler divergence for categorical systems using mixtures of Dirichlet priors

Bayesian estimation of the Kullback-Leibler divergence for categorical sytems using mixtures of Dirichlet priors

Detecting abnormal situations using the Kullback-Leibler divergence.

Bayesian estimation and prediction for certain mixtures

co-BPM: a Bayesian Model for Divergence Estimation

Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models

On Bayesian estimation via divergences

Computing Marginal and Conditional Divergences between Decomposable Models with Applications

A Unifying Framework for Some Directed Distances in Statistics

Divergence Measure of Belief Function and Its Application in Data Fusion

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Taming numerical imprecision by adapting the KL divergence to negative probabilities

Bayesian influence diagnostics using normalizing functional Bregman divergence

Bayesian inference for finite mixtures of univariate and multivariate skew-normal and skew-t distributions

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation

Probabilistic Modeling for Continuous EDA with Boltzmann Selection and Kullback-Leibeler Divergence

Nearest Neighbor Dirichlet Mixtures

Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence

Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence

Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions

Probability binning comparison: a metric for quantitating multivariate distribution differences.