Abstract:We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures of multinomial distributions for categorical variables with Dirichlet process mixtures of multivariate normal distributions for continuous variables. We incorporate dependence between the continuous and categorical variables by (i) modeling the means of the normal distributions as component-specific functions of the categorical variables and (ii) forming distinct mixture components for the categorical and continuous data with probabilities that are linked via a hierarchical model. This structure allows the model to capture complex dependencies between the categorical and continuous data with minimal tuning by the analyst. We apply the model to impute missing values due to item nonresponse in an evaluation of the redesign of the Survey of Income and Program Participation (SIPP). The goal is to compare estimates from a field test with the new design to estimates from selected individuals from a panel collected under the old design. We show that accounting for the missing data changes some conclusions about the comparability of the distributions in the two datasets. We also perform an extensive repeated sampling simulation using similar data from complete cases in an existing SIPP panel, comparing our proposed model to a default application of multiple imputation by chained equations. Imputations based on the proposed model tend to have better repeated sampling properties than the default application of chained equations in this realistic setting.

Mixture of Latent Trait Analyzers for Model-Based Clustering of Categorical Data

Without Pain -- Clustering Categorical Data Using a Bayesian Mixture of Finite Mixtures of Latent Class Analysis Models

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Exploring Heterogeneity in Clinical Trials with Latent Class Analysis

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Bayesian Mixture Models With Focused Clustering for Mixed Ordinal and Nominal Data

Degree-heterogeneous Latent Class Analysis for High-dimensional Discrete Data

Latent class analysis for multi-layer categorical data

Latent class analysis by regularized spectral clustering

Finite Mixtures of Latent Trait Analyzers With Concomitant Variables for Bipartite Networks: An Analysis of COVID-19 Data

Evaluating mixture modeling for clustering: Recommendations and cautions.

Multilevel mixtures of latent trait analyzers for clustering multi-layer bipartite networks

Latent variable mixture modeling in psychiatric research – a review and application

Some Remarks on Latent Variable Models in Categorical Data Analysis

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

Modeling Heterogeneity in Temporal Dynamics: Extending Latent State-Trait Autoregressive and Cross-lagged Panel Models to Mixture Distribution Models

Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study

Fitting latent variable mixture models

Rank-based Bayesian clustering via covariate-informed Mallows mixtures

Measurement Invariance and Differential Item Functioning in Latent Class Analysis With Stepwise Multiple Indicator Multiple Cause Modeling

An introduction and tutorial to model-based clustering in education via Gaussian mixture modelling