Abstract:In regression modelling, measurement error models are often needed to correct for uncertainty arising from measurements of covariates/predictor variables. The literature on measurement error (or errors-in-variables) modelling is plentiful, however, general algorithms and software for maximum likelihood estimation of models with measurement error are not as readily available, in a form that they can be used by applied researchers without relatively advanced statistical expertise. In this study, we develop a novel algorithm for measurement error modelling, which could in principle take any regression model fitted by maximum likelihood, or penalised likelihood, and extend it to account for uncertainty in covariates. This is achieved by exploiting an interesting property of the Monte Carlo Expectation-Maximization (MCEM) algorithm, namely that it can be expressed as an iteratively reweighted maximisation of complete data likelihoods (formed by imputing the missing values). Thus we can take any regression model for which we have an algorithm for (penalised) likelihood estimation when covariates are error-free, nest it within our proposed iteratively reweighted MCEM algorithm, and thus account for uncertainty in covariates. The approach is demonstrated on examples involving generalized linear models, point process models, generalized additive models and capture-recapture models. Because the proposed method uses maximum (penalised) likelihood, it inherits advantageous optimality and inferential properties, as illustrated by simulation. We also study the model robustness of some violations in predictor distributional assumptions. Software is provided as the refitME package on R, whose key function behaves like a refit() function, taking a fitted regression model object and re-fitting with a pre-specified amount of measurement error.

MAXIMUM-LIKELIHOOD-ESTIMATION VIA THE ECM ALGORITHM - COMPUTING THE ASYMPTOTIC VARIANCE

Maximum-Likelihood-Estimation Via the Ecm Algorithm - A General Framework

Using Em to Obtain Asymptotic Variance - Covariance Matrices - the Sem Algorithm

The ECME Algorithm: A Simple Extension of EM and ECM with Faster Monotone Convergence

Maximum Likelihood from Incomplete Data Via the EM Algorithm

On the ERM formulation and a stochastic approximation algorithm of the stochastic- R_0 EVLCP

On the global and componentwise rates of convergence of the EM algorithm

Regularized EM algorithm

A general algorithm for error-in-variables regression modelling using Monte Carlo expectation maximization

Fast ML Estimation for the Mixture of Factor Analyzers Via an ECM Algorithm

MM Algorithms for Variance Components Models

ML-ESTIMATION OF THE T-DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME

Acceleration of the EM algorithm using the vector epsilon algorithm

Statistical Machine Learning EM algorithm Lecture Notes 13 : EM algorithm

Estimation in Covariance Components Models

ML ESTIMATION OF THE t DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME

Global Consistency of Empirical Likelihood

Acceleration of the EM Algorithm

Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm

Maximum Approximated Likelihood Estimation

Maximum Likelihood Estimation of Structural Equation Models for Continuous Data: Standard Errors and Goodness of Fit