Abstract:Semi-parametric Gaussian mixtures of non-parametric regressions (SPGMNRs) are a flexible extension of Gaussian mixtures of linear regressions (GMLRs). The model assumes that the component regression functions (CRFs) are non-parametric functions of the covariate(s) whereas the component mixing proportions and variances are constants. Unfortunately, the model cannot be reliably estimated using traditional methods. A local-likelihood approach for estimating the CRFs requires that we maximize a set of local-likelihood functions. Using the Expectation-Maximization (EM) algorithm to separately maximize each local-likelihood function may lead to label-switching. This is because the posterior probabilities calculated at the local E-step are not guaranteed to be aligned. The consequence of this label-switching is wiggly and non-smooth estimates of the CRFs. In this paper, we propose a unified approach to address label-switching and obtain sensible estimates. The proposed approach has two stages. In the first stage, we propose a model-based approach to address the label-switching problem. We first note that each local-likelihood function is a likelihood function of a Gaussian mixture model (GMM). Next, we reformulate the SPGMNRs model as a mixture of these GMMs. Lastly, using a modified version of the Expectation Conditional Maximization (ECM) algorithm, we estimate the mixture of GMMs. In addition, using the mixing weights of the local GMMs, we can automatically choose the local points where local-likelihood estimation takes place. In the second stage, we propose one-step backfitting estimates of the parametric and non-parametric terms. The effectiveness of the proposed approach is demonstrated on simulated data and real data analysis.

Mixture of regression models with varying mixing proportions: A semiparametric approach

Nonparametric Mixture of Regression Models.

Dose-Response Curve Estimation: A Semiparametric Mixture Approach

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

Semiparametric Mixture Regression with Unspecified Error Distributions

Semiparametric Inference in a Genetic Mixture Model

Statistical Inference and Applications of Mixture of Varying Coefficient Models: Mixture of varying coefficient models

Machine learning embedded EM algorithms for semiparametric mixture regression models

A New Approach to Parameter Estimation of Mixture of Two Normal Distributions

A smoothed semiparametric likelihood for estimation of nonparametric finite mixture models with a copula-based dependence structure

Consistency of Estimators for Semiparametric Regression Model under Mixing Errors

A Nonparametric Estimation Method for the Multivariate Mixture Models

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

A modified EM-type algorithm to estimate semi-parametric mixtures of non-parametric regressions

t distribution-based robust semiparametric mixture regression model

Families of Parsimonious Finite Mixtures of Regression Models

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

Hypothesis Testing in Mixture Regression Models

The Bernstein-von Mises theorem for Semiparametric Mixtures

Estimation of Semi-Parametric Additive Coefficient Model

Sieve M-estimation for Semiparametric Varying-Coefficient Partially Linear Regression Model