Abstract:Adaptive lasso penalized generalized linear models (GLMs) are a powerful tool for analyzing the high-dimensional sparse data where the classical linear or normal assumption is not met. In non-distributed environments, the estimation problem of adaptive lasso penalized GLMs is often solved by the coordinate descent based algorithm developed in Friedman, Hastie, and Tibshirani (<a href="#">2010</a> Friedman, J., T. Hastie, and R. Tibshirani. 2010. Regularization Paths for Generalized Linear Models via Coordinate Descent. Journal of Statistical Software 33 (1):1–22. doi:10.18637/jss.v033.i01.<a href="/servlet/linkout?suffix=CIT0008&dbid=16&doi=10.1080%2F03610918.2021.1888998&key=10.18637%2Fjss.v033.i01">[Crossref]</a>, <a href="/servlet/linkout?suffix=CIT0008&dbid=8&doi=10.1080%2F03610918.2021.1888998&key=20808728">[PubMed]</a>, <a href="/servlet/linkout?suffix=CIT0008&dbid=128&doi=10.1080%2F03610918.2021.1888998&key=000275203200001">[Web of Science ®]</a> , <a class="google-scholar" href="http://scholar.google.com/scholar_lookup?hl=en&volume=33&publication_year=2010&pages=1-22&issue=1&author=J.+Friedman&author=T.+Hastie&author=R.+Tibshirani&title=Regularization+Paths+for+Generalized+Linear+Models+via+Coordinate+Descent&doi=10.18637%2Fjss.v033.i01">[Google Scholar]</a>), which has been well implemented in the R package glmnet. However, when applied to distributed big data, this algorithm is usually inflexible or even infeasible due to its non-parallel implementation, especially when the communication costs between the central and local machines are expensive, or the storage and computing capabilities of the central machine are insufficient. In this paper, we propose a new method, QAGLM-alasso, for the adaptive lasso penalized GLMs problem in distributed big data by applying the quadratic approximation representation of GLMs, and further develop a path-following algorithm for its estimation based on the Least Angle Regression (LARS). Theoretical analyses show that, under mild regularity conditions, the QAGLM-alasso enjoys the oracle property, and the obtained estimator is asymptotically equivalent to the original adaptive lasso. Simulation studies demonstrate that the new algorithm has similar estimation accuracy with glmnet, but is significantly faster than glmnet in distributed environments. We further illustrate the practical performance of the proposed method by analyzing a supersymmetric (SUSY) benchmark data set.

Regularized Adaptive Huber Matrix Regression and Distributed Learning

Unified algorithms for distributed regularized linear regression model

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Distributed Linear Regression with Compositional Covariates

Adaptive Huber Regression on Markov-dependent Data

Asynchronous Byzantine-Robust Stochastic Aggregation with Variance Reduction for Distributed Learning

Distributed Bayesian Matrix Decomposition for Big Data Mining and Clustering

Learning Theory of Distributed Regression with Bias Corrected Regularization Kernel Network

Robust Regularized Kernel Regression.

Distributed Event-Based Learning via ADMM

Robust Regularized Low-Rank Matrix Models for Regression and Classification

Robust Online Learning over Networks

Learnable Graph-Regularization for Matrix Decomposition

Regularized Matrix Regression

Distributed optimization and statistical learning for large-scale penalized expectile regression

A generalization of regularized dual averaging and its dynamics

Heterogeneity-aware Clustered Distributed Learning for Multi-source Data Analysis

Huber Loss Based Distributed Robust Learning Algorithm for Random Vector Functional-Link Network

Regularization for Adversarial Robust Learning

Distributed adaptive lasso penalized generalized linear models for big data

Distributed Stochastic ADMM for Matrix Factorization.