Abstract:We consider the parameter estimation problem in the deviated Gaussian mixture of experts in which the data are generated from $(1 - \lambda^{\ast}) g_0(Y| X)+ \lambda^{\ast} \sum_{i = 1}^{k_{\ast}} p_{i}^{\ast} f(Y|(a_{i}^{\ast})^{\top}X+b_i^{\ast},\sigma_{i}^{\ast})$, where $X, Y$ are respectively a covariate vector and a response variable, $g_{0}(Y|X)$ is a known function, $\lambda^{\ast} \in [0, 1]$ is true but unknown mixing proportion, and $(p_{i}^{\ast}, a_{i}^{\ast}, b_{i}^{\ast}, \sigma_{i}^{\ast})$ for $1 \leq i \leq k^{\ast}$ are unknown parameters of the Gaussian mixture of experts. This problem arises from the goodness-of-fit test when we would like to test whether the data are generated from $g_{0}(Y|X)$ (null hypothesis) or they are generated from the whole mixture (alternative hypothesis). Based on the algebraic structure of the expert functions and the distinguishability between $g_0$ and the mixture part, we construct novel Voronoi-based loss functions to capture the convergence rates of maximum likelihood estimation (MLE) for our models. We further demonstrate that our proposed loss functions characterize the local convergence rates of parameter estimation more accurately than the generalized Wasserstein, a loss function being commonly used for estimating parameters in the Gaussian mixture of experts.

On parameter estimation for semi-linear errors-in-variables models

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Local Linear M‐estimation in Non‐parametric Spatial Regression

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

A Estimate Class of G-M Linear Model

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

A Method of ARX Model Estimation of Errors-in-Variables Systems

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

Estimation of the Directions for Unknown Parameters in Semiparametric Models

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

Local linear M-estimation for spatial processes in fixed-design models

Robust estimation in a nonlinear cointegration model

Empirical likelihood confidence region for parameter in the errors-in-variables models

M-estimation for linear models with exchangeable errors

Strong consistency rates for the estimators in a heteroscedastic EV model with missing responses

Simple Estimation of Semiparametric Models with Measurement Errors

On Parameter Estimation in Deviated Gaussian Mixture of Experts

Semiparametric Gmm Estimation of Spatial Autoregressive Models

ESTIMATION IN A SEMIPARAMETRIC MONOTONE VARYING COEFFICIENT PARTIALLY LINEAR MODEL WITH ERRORS IN VARIABLES

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

Statistical Inference for Partially Linear Regression Models with Measurement Errors