Abstract:The maximum depth estimator (aka depth median) ($\bs{\beta}^*_{RD}$) induced from regression depth (RD) of Rousseeuw and Hubert (1999) (RH99) is one of the most prevailing estimators in regression. It possesses outstanding robustness similar to the univariate location counterpart. Indeed, $\bs{\beta}^*_{RD}$ can, asymptotically, resist up to $33\%$ contamination without breakdown, in contrast to the $0\%$ for the traditional (least squares and least absolute deviations) estimators (see Van Aelst and Rousseeuw, 2000) (VAR00)). The results from VAR00 are pioneering, yet they are limited to regression-symmetric populations (with a strictly positive density) and the $\epsilon$-contamination and maximum-bias model. With a fixed finite-sample size practice, the most prevailing measure of robustness for estimators is the finite-sample breakdown point (FSBP) (Donoho and Huber (1983)). Despite many attempts made in the literature, only sporadic partial results on FSBP for $\bs{\beta}^*_{RD}$ were obtained whereas an exact FSBP for $\bs{\beta}^*_{RD}$ remained open in the last twenty-plus years. Furthermore, is the asymptotic breakdown value $1/3$ (the limit of an increasing sequence of finite-sample breakdown values) relevant in the finite-sample practice? (Or what is the difference between the finite-sample and the limit breakdown values?). Such discussions are yet to be given in the literature. This article addresses the above issues, revealing an intrinsic connection between the regression depth of $\bs{\beta}^*_{RD}$ and the newly obtained exact FSBP. It justifies the employment of $\bs{\beta}^*_{RD}$ as a robust alternative to the traditional estimators and demonstrates the necessity and the merit of using the FSBP in finite-sample real practice.

Robust Regression via Mutivariate Regression Depth

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Universal Robust Regression via Maximum Mean Discrepancy

Robust Regularized Kernel Regression.

Multivariate Regression with Grossly Corrupted Observations: A Robust Approach and its Applications

Robust Regression with Covariate Filtering: Heavy Tails and Adversarial Contamination

Functional Adaptive Huber Linear Regression

Robust deep learning from weakly dependent data

Robust nonparametric regression based on deep ReLU neural networks

Robust twin support vector regression based on Huber loss function

High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality

Robust Sparse Estimation for Gaussians with Optimal Error under Huber Contamination

Non-asymptotic robustness analysis of regression depth median

Outlier-robust sparse/low-rank least-squares regression and robust matrix completion

Robust empirical risk minimization via Newton's method

Estimation beyond Missing (Completely) at Random

M robustified additive nonparametric regression

Transfer Learning for High Dimensional Robust Regression

A New Principle for Tuning-Free Huber Regression

Unified robust estimation