Abstract:This work proposes a robust loss function based on expectile penalty (named as rescaled expectile loss, RE-loss), which includes and generalizes the existing loss functions. Then some important properties of RE-loss are demonstrated such as asymmetry, nonconvexity, smoothness, boundedness and asymptotic approximation behaviors. From the viewpoints of correntropy, we analyze that the proposed RE-loss can be viewed as a correntropy-induced loss by a reproducing piecewise kernel. Furthermore, a sparse version of RE-loss (called SRE-loss function) is developed to improve sparsity by introducing a ϵ-insensitive zone. Following that, two robust regression frameworks are proposed with the proposed loss functions. However, the non-convexity of the proposed losses makes the problems difficult to optimize. We apply concave–convex procedure (CCCP) and dual theory to solve the problems effectively. The resulting algorithms converge linearly. To validate the proposed methods, we carry out numerical experiments in different scale datasets with different levels of noises and outliers, respectively. In three databases including artificial database, benchmark database and a practical application database, experimental results demonstrate that the proposed methods achieve better generalization than the traditional regression methods in most cases,especially when noise and outlier distribution are imbalance.

Asymptotics for regression models under loss of identifiability

Asymptotics for Estimation and Testing Procedures under Loss of Identifiability

Asymptotic equivalence for regression under fractional noise

Asymptotic Equivalence for Nonparametric Generalized Linear Models

Asymptotic Equivalence for Nonparametric Regression

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Asymptotic equivalence and adaptive estimation for robust nonparametric regression

Asymptotics For Threshold Regression Under General Conditions

Asymptotics of Linear Regression with Linearly Dependent Data

Regression for Asymmetric Information Problem: The Comparison of Different Methods

Asymptotic Normality and Confidence Intervals for Prediction Risk of the Min-Norm Least Squares Estimator.

Asymptotics of Estimates in Constrained Nonlinear Regression with Long-Range Dependent Innovations

Asymptotic Normality in Partial Linear Models Based on Dependent Errors

Parameter identifiability and redundancy: theoretical considerations

Asymptotics for estimating a diverging number of parameters - with and without sparsity

Accuracy Assessment for High-dimensional Linear Regression

Inequality for the variance of an asymmetric loss

Asymptotics of nonparametric L-1 regression models with dependent data

Asymptotic Properties of Marginal Least-Square Estimator for Ultrahigh-Dimensional Linear Regression Models with Correlated Errors

Robust Regression Framework with Asymmetrically Analogous to Correntropy-Induced Loss

High-Dimensional Analysis for Generalized Nonlinear Regression: from Asymptotics to Algorithm