Abstract:In this paper, we propose a general framework for combining evidence of varying quality to estimate underlying binary latent variables in the presence of restrictions imposed to respect the scientific context. The resulting algorithms cluster the multivariate binary data in a manner partly guided by prior knowledge. The primary model assumptions are that 1) subjects belong to classes defined by unobserved binary states, such as the true presence or absence of pathogens in epidemiology, or of antibodies in medicine, or the "ability" to correctly answer test questions in psychology, 2) a binary design matrix $\Gamma$ specifies relevant features in each class, and 3) measurements are independent given the latent class but can have different error rates. Conditions ensuring parameter identifiability from the likelihood function are discussed and inform the design of a novel posterior inference algorithm that simultaneously estimates the number of clusters, design matrix $\Gamma$, and model parameters. In finite samples and dimensions, we propose prior assumptions so that the posterior distribution of the number of clusters and the patterns of latent states tend to concentrate on smaller values and sparser patterns, respectively. The model readily extends to studies where some subjects' latent classes are known or important prior knowledge about differential measurement accuracy is available from external sources. The methods are illustrated with an analysis of protein data to detect clusters representing auto-antibody classes among scleroderma patients.

A Model-based Semi-Supervised Clustering Methodology

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

A model-based approach for clustering binned data

Semi-supervised clustering based on spectral clustering

How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis

Model-Based Clustering, Discriminant Analysis, and Density Estimation

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Clustering Sparse Binary Data with Hierarchical Bayesian Bernoulli Mixture Model

A Flexible Convex Optimization Model for Semi-supervised Clustering with Instance-level Constraints

Model-Based clustering of sequential data

A review on Bayesian model-based clustering

Semisupervised Clustering by Iterative Partition and Regression with Neuroscience Applications

Simultaneous Clustering and Model Selection for Multinomial Distribution: A Comparative Study

A parallelizable model-based approach for marginal and multivariate clustering

Bayesian Bi-clustering Methods with Applications in Computational Biology

A semi-supervised clustering approach using labeled data

Semi-Supervised Clustering via Matrix Factorization

A Bayesian Approach to Restricted Latent Class Models for Scientifically-Structured Clustering of Multivariate Binary Outcomes

Recent Developments in Model-Based Clustering with Applications

Model-based clustering in networks with Stochastic Community Finding

Two Novel Kernel-Based Semi-Supervised Clustering Methods By Seeding