Variable Selection and Collinearity Processing for Multivariate Data Via Row-Elastic-net Regularization

Chen, Bingzhen,Zhai, Wenjuan,Kong, Lingchen
DOI: https://doi.org/10.1007/s10182-021-00403-x
2021-01-01
AStA Advances in Statistical Analysis
Abstract:Multivariate data is collected in many fields, such as chemometrics, econometrics, financial engineering and genetics. In multivariate data, heteroscedasticity and collinearity occur frequently. And selecting material predictors is also a key issue when analyzing multivariate data. To accomplish these tasks, multivariate linear regression model is often constructed. We thus propose row-sparse elastic-net regularized multivariate Huber regression model in this paper. For this new model, we proof its grouping effect property and the property of resisting sample outliers. Based on the KKT condition, an accelerated proximal sub-gradient algorithm is designed to solve the proposed model and its convergency is also established. To demonstrate the accuracy and efficiency, simulation and real data experiments are carried out. The numerical results show that the new model can deal with heteroscedasticity and collinearity well.
What problem does this paper attempt to address?