Abstract:In this paper, we propose a general framework for combining evidence of varying quality to estimate underlying binary latent variables in the presence of restrictions imposed to respect the scientific context. The resulting algorithms cluster the multivariate binary data in a manner partly guided by prior knowledge. The primary model assumptions are that 1) subjects belong to classes defined by unobserved binary states, such as the true presence or absence of pathogens in epidemiology, or of antibodies in medicine, or the "ability" to correctly answer test questions in psychology, 2) a binary design matrix $\Gamma$ specifies relevant features in each class, and 3) measurements are independent given the latent class but can have different error rates. Conditions ensuring parameter identifiability from the likelihood function are discussed and inform the design of a novel posterior inference algorithm that simultaneously estimates the number of clusters, design matrix $\Gamma$, and model parameters. In finite samples and dimensions, we propose prior assumptions so that the posterior distribution of the number of clusters and the patterns of latent states tend to concentrate on smaller values and sparser patterns, respectively. The model readily extends to studies where some subjects' latent classes are known or important prior knowledge about differential measurement accuracy is available from external sources. The methods are illustrated with an analysis of protein data to detect clusters representing auto-antibody classes among scleroderma patients.

Bayesian clustering of mixed-type data with relevant variable identification

Clustering Mixed-Type Data via Dirichlet Process Mixture Model with Cluster-Specific Covariance Matrices

Bayesian Clustering with Variable and Transformation Selections

Bayesian Clustering for Ordinal Data Based on Finite Mixture Models of Latent Variables

Hierarchical clustering of mixed-type data based on barycentric coding

Bayesian analysis of multivariate mixed longitudinal ordinal and continuous data

Bayesian Mixture Models With Focused Clustering for Mixed Ordinal and Nominal Data

Without Pain -- Clustering Categorical Data Using a Bayesian Mixture of Finite Mixtures of Latent Class Analysis Models

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Bayesian Bi-clustering Methods with Applications in Computational Biology

Mixture of Latent Trait Analyzers for Model-Based Clustering of Categorical Data

Optimal Bayesian estimators for latent variable cluster models

Clustering Sparse Binary Data with Hierarchical Bayesian Bernoulli Mixture Model

A Cluster-Oriented Bayesian Network Approach for Mixed-Type Event Prediction with Application in Order Logistics

Bayesian nonparametric models for spatially indexed data of mixed type

Sparse Bayesian Hierarchical Modeling of High-dimensional Clustering Problems

Simultaneous Clustering and Model Selection for Multinomial Distribution: A Comparative Study

Bayesian approaches to variable selection in mixture models with application to disease clustering

A Bayesian Approach to Restricted Latent Class Models for Scientifically-Structured Clustering of Multivariate Binary Outcomes

Bayesian Nonparametric Graph Clustering

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers