Abstract:Measurement error occurs when a covariate influencing a response variable is corrupted by noise. This can lead to misleading inference outcomes, particularly in problems where accurately estimating the relationship between covariates and response variables is crucial, such as causal effect estimation. Existing methods for dealing with measurement error often rely on strong assumptions such as knowledge of the error distribution or its variance and availability of replicated measurements of the covariates. We propose a Bayesian Nonparametric Learning framework that is robust to mismeasured covariates, does not require the preceding assumptions, and can incorporate prior beliefs about the error distribution. This approach gives rise to a general framework that is suitable for both Classical and Berkson error models via the appropriate specification of the prior centering measure of a Dirichlet Process (DP). Moreover, it offers flexibility in the choice of loss function depending on the type of regression model. We provide bounds on the generalization error based on the Maximum Mean Discrepancy (MMD) loss which allows for generalization to non-Gaussian distributed errors and nonlinear covariate-response relationships. We showcase the effectiveness of the proposed framework versus prior art in real-world problems containing either Berkson or Classical measurement errors.

On Empirical Bayes Estimation of Multivariate Regression Coefficient.

The Convergence Rates of Empirical Bayes Estimation in a Multiple Linear Regression Model

THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

Empirical Bayes Test of Regression Coefficient in a Multiple Linear Regression Model

On Empirical Bayes Estimation of Variance Components in Random Effects Model

Learning from a lot: Empirical Bayes in high-dimensional prediction settings

Robust Bayesian Inference for Berkson and Classical Measurement Error Models

A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation

Bayesian variable selection in linear regression models with instrumental variables

Convergence rates of empirical Bayesian estimation in a class of linear models

Empirical Bayes via ERM and Rademacher complexities: the Poisson model

Nonparametric estimation of multivariate copula using empirical bayes method

A General Framework for Empirical Bayes Estimation in Discrete Linear Exponential Family

Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm

Tukey’s biweight estimation for uncertain regression model with imprecise observations

Empirical Bayes When Estimation Precision Predicts Parameters

Regularized maximum likelihood estimation for the random coefficients model

Empirical Bayes Estimation For The Scale Parameter With Errors In Variables

Empirical Bayes inference in sparse high-dimensional generalized linear models

Empirical Bayes Estimation of Variance Components in Two-Way Classification Random Effects Model

A flexible empirical Bayes approach to multiple linear regression and connections with penalized regression