Abstract:Recently emerging large-scale biomedical data pose exciting opportunities for scientific discoveries. However, the ultrahigh dimensionality and non-negligible measurement errors in the data may create difficulties in estimation. There are limited methods for high-dimensional covariates with measurement error, that usually require knowledge of the noise distribution and focus on linear or generalized linear models. In this work, we develop high-dimensional measurement error models for a class of Lipschitz loss functions that encompasses logistic regression, hinge loss and quantile regression, among others. Our estimator is designed to minimize the $L_1$ norm among all estimators belonging to suitable feasible sets, without requiring any knowledge of the noise distribution. Subsequently, we generalize these estimators to a Lasso analog version that is computationally scalable to higher dimensions. We derive theoretical guarantees in terms of finite sample statistical error bounds and sign consistency, even when the dimensionality increases exponentially with the sample size. Extensive simulation studies demonstrate superior performance compared to existing methods in classification and quantile regression problems. An application to a gender classification task based on brain functional connectivity in the Human Connectome Project data illustrates improved accuracy under our approach, and the ability to reliably identify significant brain connections that drive gender differences.

High-dimensional Measurement Error Models for Lipschitz Loss

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Overview of High-Dimensional Measurement Error Regression Models

High-dimensional log contrast models with measurement errors

Balanced Estimation for High-Dimensional Measurement Error Models.

On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization

High-dimensional generalized linear models and the lasso

Robust Bayesian Inference for Berkson and Classical Measurement Error Models

Covariate Selection in High-Dimensional Generalized Linear Models With Measurement Error

Weighted Lasso Estimates for Sparse Logistic Regression: Non-Asymptotic Properties with Measurement Errors

Double-Estimation-Friendly Inference for High Dimensional Misspecified Measurement Error Models

Robust adaptive LASSO in high-dimensional logistic regression

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Inference in High-Dimensional Linear Measurement Error Models

Mean and variance estimation in high-dimensional heteroscedastic models with non-convex penalties

Laplace Error Penalty-Based M-type Model Detection for a Class of High Dimensional Semiparametric Models.

A local stochastic Lipschitz condition with application to Lasso for high dimensional generalized linear models

A Simple Correction Procedure for High-Dimensional Generalized Linear Models with Measurement Error

Minimax rates of l p-losses for high-dimensional linear regression models with additive measurement errors over l q-balls

Accuracy Assessment for High-dimensional Linear Regression

High‐dimensional sparse classification using exponential weighting with empirical hinge loss