Abstract:Robust M-estimation uses loss functions, such as least absolute deviation (LAD), quantile loss and Huber's loss, to construct its objective function, in order to for example eschew the impact of outliers, whereas the difficulty in analysing the resultant estimators rests on the nonsmoothness of these losses. Generalized functions have advantages over ordinary functions in several aspects, especially generalized functions possess derivatives of any order. Generalized functions incorporate local integrable functions, the so-called regular generalized functions, while the so-called singular generalized functions (e.g. Dirac delta function) can be obtained as the limits of a sequence of sufficient smooth functions, so-called regular sequence in generalized function context. This makes it possible to use these singular generalized functions through approximation. Nevertheless, a significant contribution of this paper is to establish the convergence rate of regular sequence to nonsmooth loss that answers a call from the relevant literature. For parameter estimation where objective function may be nonsmooth, this paper first shows as a general paradigm that how generalized function approach can be used to tackle the nonsmooth loss functions in Section two using a very simple model. This approach is of general interest and applicability. We further use the approach in robust M-estimation for additive single-index cointegrating time series models; the asymptotic theory is established for the proposed estimators. We evaluate the finite-sample performance of the proposed estimation method and theory by both simulated data and an empirical analysis of predictive regression of stock returns.

Unified robust estimation

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

A highly robust estimator through partially likelihood function modeling and its application in computer vision

Robust Regularized Kernel Regression.

Robust and sparse estimation methods for high dimensional linear and logistic regression

Robust group non-convex estimations for high-dimensional partially linear models

Robust estimation of the generalised partial linear model with missing covariates

Robust estimation in joint mean–covariance regression model for longitudinal data

Robust Estimation in Stochastic Frontier Models

Robust regression for optimal individualized treatment rules

A Robust Learning Approach for Regression Models Based on Distributionally Robust Optimization.

Universal Robust Regression via Maximum Mean Discrepancy

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Robust and sparse estimators for linear regression models

Generalized robust loss functions for machine learning

Robust reduced-rank regression

Robust support vector machines via conic optimization

A Robust Learning Algorithm for Regression Models Using Distributionally Robust Optimization under the Wasserstein Metric

Robust matrix completion via Novel M-estimator Functions

Robust M-Estimation for Additive Single-Index Cointegrating Time Series Models

Robust regression based on shrinkage estimators