Abstract:We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures of multinomial distributions for categorical variables with Dirichlet process mixtures of multivariate normal distributions for continuous variables. We incorporate dependence between the continuous and categorical variables by (i) modeling the means of the normal distributions as component-specific functions of the categorical variables and (ii) forming distinct mixture components for the categorical and continuous data with probabilities that are linked via a hierarchical model. This structure allows the model to capture complex dependencies between the categorical and continuous data with minimal tuning by the analyst. We apply the model to impute missing values due to item nonresponse in an evaluation of the redesign of the Survey of Income and Program Participation (SIPP). The goal is to compare estimates from a field test with the new design to estimates from selected individuals from a panel collected under the old design. We show that accounting for the missing data changes some conclusions about the comparability of the distributions in the two datasets. We also perform an extensive repeated sampling simulation using similar data from complete cases in an existing SIPP panel, comparing our proposed model to a default application of multiple imputation by chained equations. Imputations based on the proposed model tend to have better repeated sampling properties than the default application of chained equations in this realistic setting.

A Nonparametric Estimation Method for the Multivariate Mixture Models

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

An Efficient and Provable Approach for Mixture Proportion Estimation Using Linear Independence Assumption.

Full-model estimation for non-parametric multivariate finite mixture models

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Estimation and order selection for multivariate exponential power mixture models

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

A smoothed semiparametric likelihood for estimation of nonparametric finite mixture models with a copula-based dependence structure

Copula-type Estimators for Flexible Multivariate Density Modeling using Mixtures

A novel approach for parameter estimation of mixture of two Weibull distributions in failure data modeling

A Novelty Bayesian Method For Parameters Estimation And Model Selection

Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models.

Estimation and Hypothesis-Testing in Finite Mixture-Models

Testing Homogeneity in A Multivariate Mixture Model

Robust multivariate mixture regression models with incomplete data

Mixture models for simultaneous classification and reduction of three-way data

Semiparametric Mixture Regression with Unspecified Error Distributions

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

An Empirical Likelihood Method In Mixture Models With Incomplete Classifications

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models