Abstract:We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures of multinomial distributions for categorical variables with Dirichlet process mixtures of multivariate normal distributions for continuous variables. We incorporate dependence between the continuous and categorical variables by (i) modeling the means of the normal distributions as component-specific functions of the categorical variables and (ii) forming distinct mixture components for the categorical and continuous data with probabilities that are linked via a hierarchical model. This structure allows the model to capture complex dependencies between the categorical and continuous data with minimal tuning by the analyst. We apply the model to impute missing values due to item nonresponse in an evaluation of the redesign of the Survey of Income and Program Participation (SIPP). The goal is to compare estimates from a field test with the new design to estimates from selected individuals from a panel collected under the old design. We show that accounting for the missing data changes some conclusions about the comparability of the distributions in the two datasets. We also perform an extensive repeated sampling simulation using similar data from complete cases in an existing SIPP panel, comparing our proposed model to a default application of multiple imputation by chained equations. Imputations based on the proposed model tend to have better repeated sampling properties than the default application of chained equations in this realistic setting.

Analysis of estimating the Bayes rule for Gaussian mixture models with a specified missing-data mechanism

Semi‐supervised Gaussian mixture modelling with a missing‐data mechanism in R

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

An Unsupervised Gaussian Mixture Classification Mechanism Based on Statistical Learning Analysis

Bayesian Inference for Growth Mixture Models with Latent Class Dependent Missing Data

Flexible High-Dimensional Unsupervised Learning with Missing Data

Unsupervised Learning of Dirichlet Process Mixture Models with Missing Data

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

A Bayesian hybrid method for the analysis of generalized linear models with missing-not-at-random covariates

Gaussian Mixture Model Clustering with Incomplete Data

Adaptive Learning Algorithm Based on Mixture Gaussian Background

Handling missing data in model-based clustering

Identifiability of Normal and Normal Mixture Models With Nonignorable Missing Data

An Empirical Likelihood Method In Mixture Models With Incomplete Classifications

A Note on the Robustness of a Full Bayesian Method for Nonignorable Missing Data Analysis

The Breakdown of Gaussian Universality in Classification of High-dimensional Mixtures

Mixed and missing data: a unified treatment with latent graphical models

Robust Bayesian Classification with Incomplete Data

Handling Missing Data in Growth Mixture Models

Robust multivariate mixture regression models with incomplete data

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers