Abstract:Up to now, the inaccurate supervision problem caused by label noises poses a big challenge for regression modeling. Regularized noise-robust models provide a valid way for dealing with label noises in regression tasks. They generally use robust losses to cope with label noises and further enhance model robustness by feature selection. But most of them may not work well on data sets contaminated by severe noises (whose magnitudes are extreme), because severe noises do not coincide with their noise assumptions. To address this concern, this paper proposes a robust adaptive linear regression method named TC-ALASSO (Truncated Cauchy Adaptive LASSO), in which model learning and feature selection are finished simultaneously. The fat-tailed Cauchy distribution and truncation theory are adopted to deal with moderate noises and identified extreme noises, respectively, and construct the Truncated Cauchy loss for regression tasks. Moreover, TC-ALASSO applies the adaptive regularizer to finish feature selection well. Note that its adaptive regularizer weights are acquired according to regression coefficient estimations under the truncated Cauchy loss. We also theoretically analyze the robustness of proposed TC-ALASSO in this paper. The experimental results on artificial and benchmark data sets all confirm the robustness and effectiveness of TC-ALASSO. In addition, experimental results on face recognition databases validate the performance advantage of TC-ALASSO over state-of-the-art methods in dealing with extreme illumination variations.

Canal-LASSO: A Sparse Noise-Resilient Online Linear Regression Model

Average case analysis of Lasso under ultra-sparse conditions

Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso

Fused LASSO Penalized Least Absolute Deviation Estimator for High Dimensional Linear Regression

Scaled sparse linear regression

Robust Variable Selection Based on Relaxed Lad Lasso

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

WLAD-LASSO Method for Robust Estimation and Variable Selection in Partially Linear Models

Regression Coefficient and Autoregressive Order Shrinkage and Selection Via the Lasso

Generalized and Robust Least Squares Regression.

A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

Development of a Novel Variable Selection Algorithm for LSTM with LASSO

A robust adaptive linear regression method for severe noise

Robust RLS Via the Nonconvex Sparsity Prompting Penalties of Outlier Components.

A Joint Least Squares and Least Absolute Deviation Model.

Kernel-based Regression Via a Novel Robust Loss Function and Iteratively Reweighted Least Squares

The Lasso under Poisson-Like Heteroscedasticity

A LASSO-Type Approach to Variable Selection and Estimation for Censored Regression Model

Subset Selection with Shrinkage: Sparse Linear Modeling when the SNR is low

Robust Supervised and Semisupervised Least Squares Regression Using ℓ2,p-Norm Minimization

Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels