Abstract:Recently emerging large-scale biomedical data pose exciting opportunities for scientific discoveries. However, the ultrahigh dimensionality and non-negligible measurement errors in the data may create difficulties in estimation. There are limited methods for high-dimensional covariates with measurement error, that usually require knowledge of the noise distribution and focus on linear or generalized linear models. In this work, we develop high-dimensional measurement error models for a class of Lipschitz loss functions that encompasses logistic regression, hinge loss and quantile regression, among others. Our estimator is designed to minimize the $L_1$ norm among all estimators belonging to suitable feasible sets, without requiring any knowledge of the noise distribution. Subsequently, we generalize these estimators to a Lasso analog version that is computationally scalable to higher dimensions. We derive theoretical guarantees in terms of finite sample statistical error bounds and sign consistency, even when the dimensionality increases exponentially with the sample size. Extensive simulation studies demonstrate superior performance compared to existing methods in classification and quantile regression problems. An application to a gender classification task based on brain functional connectivity in the Human Connectome Project data illustrates improved accuracy under our approach, and the ability to reliably identify significant brain connections that drive gender differences.

High-dimensional generalized linear models and the lasso

Adaptive Lasso in high-dimensional settings

A local stochastic Lipschitz condition with application to Lasso for high dimensional generalized linear models

Non-asymptotic Oracle Inequalities for the High-Dimensional Cox Regression via Lasso

Adaptive Lasso for generalized linear models with a diverging number of parameters

Non-asymptotic Oracle Inequalities for the Lasso and Group Lasso in high dimensional logistic model

Overlapping Group Lasso for High-Dimensional Generalized Linear Models

Mean and variance estimation in high-dimensional heteroscedastic models with non-convex penalties

High-dimensional Measurement Error Models for Lipschitz Loss

A sparse-group lasso

The Adaptive Lasso and Its Oracle Properties

Convergence and Sparsity of Lasso and Group Lasso in High-Dimensional Generalized Linear Models

Penalized empirical likelihood for high-dimensional generalized linear models with longitudinal data

Weighted Lasso Estimates for Sparse Logistic Regression: Non-Asymptotic Properties with Measurement Errors

The partial linear model in high dimensions

Generic error bounds for the generalized Lasso with sub-exponential data

Robust adaptive LASSO in high-dimensional logistic regression

The high-dimensional statistical analysis of sparse Group Lasso

Asymptotic Properties of Lasso+mLS and Lasso+Ridge in Sparse High-Dimensional Linear Regression

Confidence regions for high-dimensional generalized linear models under sparsity