Abstract:The finite mixture regression is a method to account for heterogeneity in relationship between the response variable and the predictor variables. The goal of this research is to investigate the variable selection issue within each component in the finite mixture regression. This has not been studied much in the literature from a Bayesian perspective. We propose an approach by embedding variable selection into the data augmentation method that iteratively updates estimation in two steps: estimate parameters for each component and determine the latent membership of each observation. Componentwise variable selection is realized by imposing special priors or procedures designed for parsimony in the first step. Due to separation of the two steps, our approach provides a freedom to choose from a wide variety of variable selection techniques. In particular, we illustrate how two popular variable selection techniques can be embedded in the proposed approach: g-prior and Stochastic Search Variable Selection. A simulation study is conducted to assess performance of the proposed approach under a variety of scenarios through investigating accuracy of variable selection and clustering. Results show that the proposed approach successfully identifies important variables even in noisy scenarios. The proposed approach is also applied to a real data set from bioinformatics and the results provide evidence to an existing hypothesis.

Full-model estimation for non-parametric multivariate finite mixture models

Estimating the Number of Components in Finite Mixture Models via Variational Approximation

Bayesian estimation and prediction for certain mixtures

A Novelty Bayesian Method for Unsupervised Learning of Finite Mixture Models

Model-based clustering based on sparse finite Gaussian mixtures

Conditional mixture modeling and model-based clustering

Mixture Models With a Prior on the Number of Components

A Nonparametric Estimation Method for the Multivariate Mixture Models

Model Selection for Gaussian Mixture Models

Finite Mixture Models with Negative Components.

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Estimation and order selection for multivariate exponential power mixture models

Inference on two component mixtures under tail restrictions

Estimation and Hypothesis-Testing in Finite Mixture-Models

A smoothed semiparametric likelihood for estimation of nonparametric finite mixture models with a copula-based dependence structure

Estimation and hypothesis testing in finite mixture models

Modeling Conditional Densities Using Finite Smooth Mixtures

An algorithm for estimating number of components of Gaussian mixture model based on penalized distance

Automatic Estimation Algorithm of Component Number of Mixture Model Based on Penalized Distance

Componentwise variable selection in finite mixture regression

Bayesian mixture models (in)consistency for the number of clusters